2024-09-11T01:48:05.878 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T01:48:05.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T01:48:06.002 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935 branch: wip-hemanth-testing-2024-09-10-0723 description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} email: hyelloji@redhat.com first_in_suite: false job_id: '7899935' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos min: 10 paxos service trim min: 5 paxos trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true bluestore write v2 random: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - slow request - overall HEALTH_ mon_bind_msgr2: false sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 9167 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZbwLdZu+L+u1UPPH7l/SFFGKXcwnID7RbfnncWYguUu7NsmDmWRiXMJn4m6R74i0Y0O6rttLK6iLhRaysKUlM= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL8vTrbjGcr7FnH2Lg7LIkxUE7JfczL1U6HRY5O4AfDf4DhA9PdbPCqwDuRPqDeXXnn8PrcNvZOcD/+epioXYF0= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 thrash_delay: 1 thrash_many: true - exec: client.0: - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_17:16:14 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T01:48:06.002 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-11T01:48:06.003 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-11T01:48:06.003 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T01:48:06.004 INFO:teuthology.task.internal:Checking packages... 2024-09-11T01:48:06.025 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-11T01:48:06.025 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T01:48:06.025 INFO:teuthology.packaging:ref: None 2024-09-11T01:48:06.026 INFO:teuthology.packaging:tag: None 2024-09-11T01:48:06.026 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-11T01:48:06.026 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T01:48:06.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-11T01:48:06.193 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-11T01:48:06.195 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T01:48:06.430 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T01:48:06.430 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T01:48:06.464 INFO:teuthology.task.internal:Saving configuration 2024-09-11T01:48:06.481 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T01:48:06.495 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T01:48:06.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 01:43:07.315204', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZbwLdZu+L+u1UPPH7l/SFFGKXcwnID7RbfnncWYguUu7NsmDmWRiXMJn4m6R74i0Y0O6rttLK6iLhRaysKUlM='} 2024-09-11T01:48:06.559 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 01:43:07.313237', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL8vTrbjGcr7FnH2Lg7LIkxUE7JfczL1U6HRY5O4AfDf4DhA9PdbPCqwDuRPqDeXXnn8PrcNvZOcD/+epioXYF0='} 2024-09-11T01:48:06.559 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T01:48:06.571 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2024-09-11T01:48:06.571 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-09-11T01:48:06.571 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T01:48:06.681 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0654b97eb0>, signals=[15]) 2024-09-11T01:48:06.681 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T01:48:06.687 INFO:teuthology.task.internal:Opening connections... 2024-09-11T01:48:06.687 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-11T01:48:06.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:48:06.792 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T01:48:06.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:48:06.877 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T01:48:06.884 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-11T01:48:06.902 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-11T01:48:06.902 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-11T01:48:06.959 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-09-11T01:48:06.959 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T01:48:06.960 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T01:48:06.961 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-11T01:48:06.992 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-09-11T01:48:07.010 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-09-11T01:48:07.010 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-09-11T01:48:07.067 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-09-11T01:48:07.067 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-09-11T01:48:07.067 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-09-11T01:48:07.067 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-09-11T01:48:07.067 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-09-11T01:48:07.068 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-09-11T01:48:07.068 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T01:48:07.068 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-09-11T01:48:07.068 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-09-11T01:48:07.068 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T01:48:07.068 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-09-11T01:48:07.068 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T01:48:07.068 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T01:48:07.068 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T01:48:07.069 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-09-11T01:48:07.100 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T01:48:07.109 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T01:48:07.114 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T01:48:07.114 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-11T01:48:07.117 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-09-11T01:48:07.133 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T01:48:07.138 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T01:48:07.138 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-11T01:48:07.175 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-09-11T01:48:07.484 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T01:48:07.555 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T01:48:07.573 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T01:48:07.573 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.f': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T01:48:07.573 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T01:48:07.574 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T01:48:07.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:48:07.591 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-09-11T01:48:07.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:48:07.592 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-11T01:48:07.650 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-503.el9.x86_64 2024-09-11T01:48:07.650 INFO:teuthology.task.kernel:Running kernel on smithi203: 5.14.0-503.el9.x86_64 2024-09-11T01:48:07.650 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum install -y kernel 2024-09-11T01:48:07.651 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-503.el9.x86_64 2024-09-11T01:48:07.652 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-503.el9.x86_64 2024-09-11T01:48:07.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-09-11T01:48:10.015 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T01:48:11.770 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 8.2 MB 00:02 2024-09-11T01:48:13.604 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-11T01:48:18.613 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.5 MB 00:01 2024-09-11T01:48:20.022 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 19 kB 00:00 2024-09-11T01:48:20.927 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T01:48:21.749 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 1.9 MB/s | 20 MB 00:10 2024-09-11T01:48:26.024 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-11T01:48:26.315 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T01:48:27.591 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 19 kB 00:00 2024-09-11T01:48:28.338 INFO:teuthology.orchestra.run.smithi203.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T01:48:28.339 INFO:teuthology.orchestra.run.smithi203.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T01:48:28.412 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-11T01:48:28.428 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:48:28.440 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:48:28.440 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-11T01:48:28.440 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:48:28.440 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:48:28.440 INFO:teuthology.orchestra.run.smithi203.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T01:48:28.440 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-11T01:48:28.440 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T01:48:28.441 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T01:48:28.441 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T01:48:28.441 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:48:28.441 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:48:28.441 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:48:28.441 INFO:teuthology.orchestra.run.smithi203.stdout:Install 4 Packages 2024-09-11T01:48:28.441 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:48:28.442 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 79 M 2024-09-11T01:48:28.442 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 126 M 2024-09-11T01:48:28.442 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:48:29.109 INFO:teuthology.orchestra.run.smithi203.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2024-09-11T01:48:31.108 INFO:teuthology.orchestra.run.smithi203.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.1 MB/s | 16 MB 00:02 2024-09-11T01:48:31.617 INFO:teuthology.orchestra.run.smithi203.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-11T01:48:32.150 INFO:teuthology.orchestra.run.smithi203.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 9.6 MB/s | 35 MB 00:03 2024-09-11T01:48:32.150 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:48:32.151 INFO:teuthology.orchestra.run.smithi203.stdout:Total 21 MB/s | 79 MB 00:03 2024-09-11T01:48:32.839 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:48:33.195 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:48:33.195 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:48:33.843 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-11T01:48:34.196 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:48:34.197 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:48:35.866 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T01:48:35.866 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T01:48:35.970 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:48:35.979 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:48:35.980 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-09-11T01:48:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:48:35.981 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 79 M 2024-09-11T01:48:35.981 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 126 M 2024-09-11T01:48:35.981 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:48:36.111 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 271 kB/s | 23 kB 00:00 2024-09-11T01:48:36.668 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:48:37.161 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-11T01:48:37.329 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T01:48:37.410 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T01:48:39.486 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 8.5 MB/s | 29 MB 00:03 2024-09-11T01:48:40.208 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T01:48:40.278 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-11T01:48:40.278 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:48:40.278 INFO:teuthology.orchestra.run.smithi073.stdout:Total 18 MB/s | 79 MB 00:04 2024-09-11T01:48:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T01:48:40.958 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:48:41.292 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:48:41.292 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:48:42.277 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:48:42.277 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:48:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:48:45.158 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T01:48:45.195 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:48:45.389 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T01:48:45.470 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T01:48:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T01:48:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T01:48:50.035 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:48:53.215 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T01:48:53.321 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:48:58.148 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:49:28.415 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:49:28.455 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:49:28.740 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:49:28.740 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T01:49:28.740 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T01:49:28.740 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T01:49:29.621 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:49:29.621 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:49:29.621 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:49:29.621 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T01:49:29.621 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T01:49:29.622 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T01:49:29.622 INFO:teuthology.orchestra.run.smithi203.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T01:49:29.622 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:49:29.622 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:49:29.997 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T01:49:30.088 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T01:49:30.088 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T01:49:30.088 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T01:49:30.089 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T01:49:30.089 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T01:49:30.089 INFO:teuthology.task.kernel:Installing distro kernel on mon.f... 2024-09-11T01:49:30.089 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi203.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T01:49:30.089 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T01:49:30.148 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T01:49:30.148 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T01:49:30.148 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -qi grub2-tools 2024-09-11T01:49:30.185 INFO:teuthology.orchestra.run.smithi203.stdout:Name : grub2-tools 2024-09-11T01:49:30.185 INFO:teuthology.orchestra.run.smithi203.stdout:Epoch : 1 2024-09-11T01:49:30.185 INFO:teuthology.orchestra.run.smithi203.stdout:Version : 2.06 2024-09-11T01:49:30.185 INFO:teuthology.orchestra.run.smithi203.stdout:Release : 82.el9 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: x86_64 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Group : Unspecified 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Size : 8274670 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:License : GPLv3+ 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Packager : builder@centos.org 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Vendor : CentOS 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T01:49:30.186 INFO:teuthology.orchestra.run.smithi203.stdout:Summary : Support tools for GRUB. 2024-09-11T01:49:30.187 INFO:teuthology.orchestra.run.smithi203.stdout:Description : 2024-09-11T01:49:30.187 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:49:30.187 INFO:teuthology.orchestra.run.smithi203.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T01:49:30.187 INFO:teuthology.orchestra.run.smithi203.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T01:49:30.187 INFO:teuthology.orchestra.run.smithi203.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T01:49:30.187 INFO:teuthology.orchestra.run.smithi203.stdout:hardware devices. 2024-09-11T01:49:30.187 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:49:30.187 INFO:teuthology.orchestra.run.smithi203.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T01:49:30.188 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T01:49:30.188 INFO:teuthology.task.kernel:Updating grub on smithi203 to boot 5.14.0-505.el9.x86_64 2024-09-11T01:49:30.188 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T01:49:30.855 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-09-11T01:49:32.188 INFO:teuthology.orchestra.run.smithi203.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T01:49:32.223 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-09-11T01:49:32.225 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-09-11T01:49:32.240 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.NyWJY7KhaF 2024-09-11T01:49:32.241 DEBUG:teuthology.orchestra.run.smithi203:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NyWJY7KhaF 2024-09-11T01:49:32.307 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.NyWJY7KhaF 2024-09-11T01:49:32.444 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.NyWJY7KhaF is 6KB 2024-09-11T01:49:32.493 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.NyWJY7KhaF 2024-09-11T01:49:32.508 DEBUG:teuthology.orchestra.run.smithi203:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T01:49:32.571 INFO:teuthology.orchestra.run.smithi203.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T01:49:32.571 INFO:teuthology.orchestra.run.smithi203.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T01:49:32.571 INFO:teuthology.orchestra.run.smithi203.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T01:49:32.571 INFO:teuthology.orchestra.run.smithi203.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T01:49:32.572 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T01:49:32.736 DEBUG:teuthology.orchestra.run.smithi203:> sudo shutdown -r now 2024-09-11T01:49:36.563 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:49:36.602 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:49:37.006 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:49:37.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T01:49:37.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T01:49:37.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T01:49:37.906 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T01:49:37.906 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:49:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:49:37.906 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T01:49:37.906 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T01:49:37.906 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T01:49:37.906 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T01:49:37.906 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:49:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:49:38.268 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T01:49:38.367 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T01:49:38.367 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T01:49:38.367 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T01:49:38.367 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T01:49:38.367 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T01:49:38.367 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T01:49:38.368 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T01:49:38.368 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T01:49:38.426 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T01:49:38.426 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T01:49:38.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-09-11T01:49:38.458 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-09-11T01:49:38.458 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-09-11T01:49:38.458 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-09-11T01:49:38.458 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 82.el9 2024-09-11T01:49:38.458 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-09-11T01:49:38.458 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T01:49:38.458 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8274670 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T01:49:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T01:49:38.460 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T01:49:38.460 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-09-11T01:49:38.460 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:49:38.460 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T01:49:38.461 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T01:49:38.461 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-505.el9.x86_64 2024-09-11T01:49:38.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T01:49:39.163 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-11T01:49:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T01:49:40.578 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-11T01:49:40.580 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-11T01:49:40.595 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.aUbHD4Yw7t 2024-09-11T01:49:40.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aUbHD4Yw7t 2024-09-11T01:49:40.669 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.aUbHD4Yw7t 2024-09-11T01:49:40.813 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.aUbHD4Yw7t is 6KB 2024-09-11T01:49:40.863 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.aUbHD4Yw7t 2024-09-11T01:49:40.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T01:49:40.940 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T01:49:40.941 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T01:49:40.941 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T01:49:40.941 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T01:49:40.942 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T01:49:41.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-11T01:50:02.761 INFO:teuthology.task.kernel:Checking client mon.f for new kernel version... 2024-09-11T01:50:02.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-11T01:50:02.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:50:11.101 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T01:50:11.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-11T01:50:11.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:50:21.245 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-11T01:50:29.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-11T01:50:30.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-11T01:50:30.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:50:33.309 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-11T01:50:38.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-11T01:50:38.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:50:41.501 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-11T01:50:45.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-11T01:50:45.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:50:53.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-11T01:50:53.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:51:03.741 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-09-11T01:51:18.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-11T01:51:18.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:51:19.059 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-11T01:51:19.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-11T01:51:19.530 INFO:teuthology.task.kernel:Checking kernel version of mon.f, want "5.14.0-505.el9.x86_64"... 2024-09-11T01:51:19.530 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-09-11T01:51:19.546 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-505.el9.x86_64 2024-09-11T01:51:19.546 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T01:51:19.546 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T01:51:19.547 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T01:51:20.548 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2024-09-11T01:51:20.548 DEBUG:teuthology.orchestra.run.smithi203:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T01:51:20.762 INFO:teuthology.orchestra.run.smithi203.stdout:ttyS1 2024-09-11T01:51:20.784 DEBUG:teuthology.parallel:result is None 2024-09-11T01:51:25.361 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-11T01:51:25.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-11T01:51:25.896 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T01:51:25.897 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-11T01:51:25.911 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-505.el9.x86_64 2024-09-11T01:51:25.911 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T01:51:25.911 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T01:51:25.912 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T01:51:26.913 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T01:51:26.913 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T01:51:27.039 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-11T01:51:27.063 DEBUG:teuthology.parallel:result is None 2024-09-11T01:51:27.063 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T01:51:27.072 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T01:51:27.072 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T01:51:27.077 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T01:51:27.097 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T01:51:27.104 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T01:51:27.110 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T01:51:27.110 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T01:51:27.130 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T01:51:27.260 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T01:51:27.266 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T01:51:27.266 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T01:51:27.269 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T01:51:27.305 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T01:51:27.308 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T01:51:27.316 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T01:51:27.320 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T01:51:27.321 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T01:51:27.331 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T01:51:27.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T01:51:27.359 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T01:51:27.389 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T01:51:27.399 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T01:51:27.399 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T01:51:27.422 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T01:51:27.446 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T01:51:27.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T01:51:27.657 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T01:51:27.708 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T01:51:27.736 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:51:27.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T01:51:27.800 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T01:51:27.855 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T01:51:27.902 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T01:51:27.995 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T01:51:28.032 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:51:28.033 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T01:51:28.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-11T01:51:28.103 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-09-11T01:51:28.154 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T01:51:28.194 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T01:51:28.598 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T01:51:28.605 INFO:teuthology.task.internal:Starting timer... 2024-09-11T01:51:28.605 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T01:51:28.614 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T01:51:28.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-09-11T01:51:28.709 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-09-11T01:51:28.711 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-09-11T01:51:28.754 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-09-11T01:51:28.756 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T01:51:28.756 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-09-11T01:51:28.801 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-09-11T01:51:28.802 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-09-11T01:51:28.835 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-09-11T01:51:28.835 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-09-11T01:51:28.835 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T01:51:28.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:51:28.861 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T01:51:28.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:51:28.903 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T01:51:28.903 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-09-11T01:51:28.935 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-09-11T01:51:28.976 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T01:51:28.987 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T01:51:28.990 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T01:51:29.108 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T01:51:29.118 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T01:51:29.119 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T01:55:11.021 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-09-11T01:55:11.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-11T01:55:11.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:55:11.128 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-11T01:55:11.203 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-11T01:55:11.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-11T01:55:11.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T01:55:11.304 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-11T01:55:11.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-11T01:55:11.381 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T01:55:11.393 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T01:55:11.393 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T01:55:11.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T01:55:11.396 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T01:55:11.396 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T01:55:11.422 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T01:55:11.436 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T01:55:11.451 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T01:55:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-09-11T01:55:11.467 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T01:55:11.471 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-09-11T01:55:11.485 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T01:55:11.493 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-09-11T01:55:11.499 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T01:55:11.504 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-09-11T01:55:11.519 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T01:55:11.533 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T01:55:11.556 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-11T01:55:11.559 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T01:55:11.560 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-11T01:55:11.560 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:55:11.560 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:55:11.560 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:55:11.560 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:55:11.589 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-11T01:55:11.593 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T01:55:11.593 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-11T01:55:11.593 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:55:11.593 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:55:11.593 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:55:11.593 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:55:11.594 INFO:teuthology.run_tasks:Running task install... 2024-09-11T01:55:11.601 DEBUG:teuthology.task.install:project ceph 2024-09-11T01:55:11.602 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-11T01:55:11.602 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-11T01:55:11.602 INFO:teuthology.task.install:Using flavor: default 2024-09-11T01:55:11.607 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T01:55:11.607 INFO:teuthology.task.install:extra packages: [] 2024-09-11T01:55:11.607 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T01:55:11.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T01:55:11.610 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T01:55:11.610 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T01:55:11.762 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T01:55:11.762 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T01:55:11.775 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T01:55:11.775 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T01:55:11.879 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T01:55:11.879 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:55:11.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T01:55:11.892 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T01:55:11.892 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:55:11.892 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T01:55:11.904 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T01:55:11.904 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T01:55:11.918 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-11T01:55:11.918 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T01:55:11.970 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T01:55:11.983 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T01:55:12.045 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T01:55:12.058 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T01:55:12.109 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-09-11T01:55:12.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-09-11T01:55:12.122 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-09-11T01:55:12.123 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-09-11T01:55:12.344 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-09-11T01:55:12.355 INFO:teuthology.orchestra.run.smithi203.stdout:45 files removed 2024-09-11T01:55:12.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw 2024-09-11T01:55:12.382 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw 2024-09-11T01:55:12.941 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 293 kB/s | 84 kB 00:00 2024-09-11T01:55:12.943 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-11T01:55:13.236 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-11T01:55:13.244 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-11T01:55:13.509 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-11T01:55:13.520 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-11T01:55:14.029 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-11T01:55:15.301 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-11T01:55:15.938 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-11T01:55:19.894 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 5.9 MB/s | 20 MB 00:03 2024-09-11T01:55:20.439 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.5 MB 00:00 2024-09-11T01:55:21.907 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 19 kB 00:00 2024-09-11T01:55:22.695 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-11T01:55:25.544 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-11T01:55:27.086 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-11T01:55:27.949 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-11T01:55:28.159 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T01:55:30.535 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:55:30.564 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:55:30.564 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:55:30.564 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:55:30.564 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:55:30.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T01:55:30.564 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-09-11T01:55:30.565 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T01:55:30.565 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T01:55:30.565 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-11T01:55:30.565 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T01:55:30.565 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T01:55:30.565 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T01:55:30.565 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T01:55:30.565 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T01:55:30.565 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T01:55:30.566 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout:Installing weak dependencies: 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:55:30.567 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:55:30.568 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:55:30.568 INFO:teuthology.orchestra.run.smithi203.stdout:Install 31 Packages 2024-09-11T01:55:30.568 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 2 Packages 2024-09-11T01:55:30.568 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:55:30.569 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 62 M 2024-09-11T01:55:30.569 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:55:31.510 INFO:teuthology.orchestra.run.smithi203.stdout:(1/33): ceph-base-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-11T01:55:31.578 INFO:teuthology.orchestra.run.smithi203.stdout:(2/33): ceph-selinux-19.3.0-4854.g8f219c47.el9. 375 kB/s | 25 kB 00:00 2024-09-11T01:55:31.686 INFO:teuthology.orchestra.run.smithi203.stdout:(3/33): libcephfs2-19.3.0-4854.g8f219c47.el9.x8 6.8 MB/s | 755 kB 00:00 2024-09-11T01:55:31.780 INFO:teuthology.orchestra.run.smithi203.stdout:(4/33): libradosstriper1-19.3.0-4854.g8f219c47. 5.4 MB/s | 507 kB 00:00 2024-09-11T01:55:32.187 INFO:teuthology.orchestra.run.smithi203.stdout:(5/33): ceph-common-19.3.0-4854.g8f219c47.el9.x 19 MB/s | 22 MB 00:01 2024-09-11T01:55:32.304 INFO:teuthology.orchestra.run.smithi203.stdout:(6/33): ceph-radosgw-19.3.0-4854.g8f219c47.el9. 8.6 MB/s | 11 MB 00:01 2024-09-11T01:55:32.329 INFO:teuthology.orchestra.run.smithi203.stdout:(7/33): python3-ceph-argparse-19.3.0-4854.g8f21 318 kB/s | 45 kB 00:00 2024-09-11T01:55:32.354 INFO:teuthology.orchestra.run.smithi203.stdout:(8/33): python3-ceph-common-19.3.0-4854.g8f219c 2.8 MB/s | 143 kB 00:00 2024-09-11T01:55:32.379 INFO:teuthology.orchestra.run.smithi203.stdout:(9/33): python3-cephfs-19.3.0-4854.g8f219c47.el 3.1 MB/s | 161 kB 00:00 2024-09-11T01:55:32.405 INFO:teuthology.orchestra.run.smithi203.stdout:(10/33): python3-rados-19.3.0-4854.g8f219c47.el 6.2 MB/s | 321 kB 00:00 2024-09-11T01:55:32.430 INFO:teuthology.orchestra.run.smithi203.stdout:(11/33): python3-rbd-19.3.0-4854.g8f219c47.el9. 5.9 MB/s | 306 kB 00:00 2024-09-11T01:55:32.455 INFO:teuthology.orchestra.run.smithi203.stdout:(12/33): python3-rgw-19.3.0-4854.g8f219c47.el9. 1.9 MB/s | 99 kB 00:00 2024-09-11T01:55:32.539 INFO:teuthology.orchestra.run.smithi203.stdout:(13/33): librgw2-19.3.0-4854.g8f219c47.el9.x86_ 7.3 MB/s | 5.5 MB 00:00 2024-09-11T01:55:32.598 INFO:teuthology.orchestra.run.smithi203.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 639 kB/s | 107 kB 00:00 2024-09-11T01:55:32.640 INFO:teuthology.orchestra.run.smithi203.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-11T01:55:32.665 INFO:teuthology.orchestra.run.smithi203.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 815 kB/s | 171 kB 00:00 2024-09-11T01:55:32.690 INFO:teuthology.orchestra.run.smithi203.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-11T01:55:32.724 INFO:teuthology.orchestra.run.smithi203.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T01:55:32.749 INFO:teuthology.orchestra.run.smithi203.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-11T01:55:32.774 INFO:teuthology.orchestra.run.smithi203.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 505 kB/s | 42 kB 00:00 2024-09-11T01:55:32.799 INFO:teuthology.orchestra.run.smithi203.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-11T01:55:32.816 INFO:teuthology.orchestra.run.smithi203.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 860 kB/s | 36 kB 00:00 2024-09-11T01:55:32.833 INFO:teuthology.orchestra.run.smithi203.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-09-11T01:55:32.901 INFO:teuthology.orchestra.run.smithi203.stdout:(24/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.0 MB/s | 309 kB 00:00 2024-09-11T01:55:32.917 INFO:teuthology.orchestra.run.smithi203.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-11T01:55:32.934 INFO:teuthology.orchestra.run.smithi203.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-11T01:55:32.959 INFO:teuthology.orchestra.run.smithi203.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-11T01:55:32.993 INFO:teuthology.orchestra.run.smithi203.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T01:55:33.027 INFO:teuthology.orchestra.run.smithi203.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-11T01:55:33.119 INFO:teuthology.orchestra.run.smithi203.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-11T01:55:33.194 INFO:teuthology.orchestra.run.smithi203.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-11T01:55:33.253 INFO:teuthology.orchestra.run.smithi203.stdout:(32/33): librados2-19.3.0-4854.g8f219c47.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-11T01:55:33.395 INFO:teuthology.orchestra.run.smithi203.stdout:(33/33): librbd1-19.3.0-4854.g8f219c47.el9.x86_ 12 MB/s | 3.2 MB 00:00 2024-09-11T01:55:33.397 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T01:55:33.399 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:55:33.400 INFO:teuthology.orchestra.run.smithi203.stdout:Total 22 MB/s | 62 MB 00:02 2024-09-11T01:55:33.519 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:55:33.555 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:55:33.555 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:55:34.256 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:55:34.257 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:55:35.783 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:55:35.791 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:55:35.791 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T01:55:35.792 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T01:55:35.793 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T01:55:35.794 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:55:35.795 INFO:teuthology.orchestra.run.smithi073.stdout:Install 31 Packages 2024-09-11T01:55:35.796 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 2 Packages 2024-09-11T01:55:35.796 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:55:35.796 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 62 M 2024-09-11T01:55:35.796 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:55:35.886 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T01:55:35.917 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-11T01:55:35.942 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-11T01:55:35.964 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-11T01:55:35.991 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-11T01:55:36.148 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-11T01:55:36.203 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-11T01:55:36.506 INFO:teuthology.orchestra.run.smithi073.stdout:(1/33): ceph-base-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-11T01:55:36.573 INFO:teuthology.orchestra.run.smithi073.stdout:(2/33): ceph-selinux-19.3.0-4854.g8f219c47.el9. 379 kB/s | 25 kB 00:00 2024-09-11T01:55:36.585 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-11T01:55:36.653 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-11T01:55:36.682 INFO:teuthology.orchestra.run.smithi073.stdout:(3/33): libcephfs2-19.3.0-4854.g8f219c47.el9.x8 6.8 MB/s | 755 kB 00:00 2024-09-11T01:55:36.729 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-11T01:55:36.818 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 8/35 2024-09-11T01:55:36.846 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/35 2024-09-11T01:55:36.849 INFO:teuthology.orchestra.run.smithi073.stdout:(4/33): ceph-radosgw-19.3.0-4854.g8f219c47.el9. 13 MB/s | 11 MB 00:00 2024-09-11T01:55:36.883 INFO:teuthology.orchestra.run.smithi073.stdout:(5/33): libradosstriper1-19.3.0-4854.g8f219c47. 2.5 MB/s | 507 kB 00:00 2024-09-11T01:55:36.909 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/35 2024-09-11T01:55:36.941 INFO:teuthology.orchestra.run.smithi073.stdout:(6/33): python3-ceph-argparse-19.3.0-4854.g8f21 778 kB/s | 45 kB 00:00 2024-09-11T01:55:36.946 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-11T01:55:37.000 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9. 11/35 2024-09-11T01:55:37.016 INFO:teuthology.orchestra.run.smithi073.stdout:(7/33): python3-ceph-common-19.3.0-4854.g8f219c 1.9 MB/s | 143 kB 00:00 2024-09-11T01:55:37.068 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 12/35 2024-09-11T01:55:37.090 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 13/35 2024-09-11T01:55:37.125 INFO:teuthology.orchestra.run.smithi073.stdout:(8/33): librgw2-19.3.0-4854.g8f219c47.el9.x86_6 20 MB/s | 5.5 MB 00:00 2024-09-11T01:55:37.159 INFO:teuthology.orchestra.run.smithi073.stdout:(9/33): python3-cephfs-19.3.0-4854.g8f219c47.el 1.1 MB/s | 161 kB 00:00 2024-09-11T01:55:37.163 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 13/35 2024-09-11T01:55:37.184 INFO:teuthology.orchestra.run.smithi073.stdout:(10/33): python3-rados-19.3.0-4854.g8f219c47.el 5.4 MB/s | 321 kB 00:00 2024-09-11T01:55:37.209 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-11T01:55:37.210 INFO:teuthology.orchestra.run.smithi073.stdout:(11/33): python3-rbd-19.3.0-4854.g8f219c47.el9. 5.9 MB/s | 306 kB 00:00 2024-09-11T01:55:37.235 INFO:teuthology.orchestra.run.smithi073.stdout:(12/33): python3-rgw-19.3.0-4854.g8f219c47.el9. 1.9 MB/s | 99 kB 00:00 2024-09-11T01:55:37.373 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-11T01:55:37.418 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-11T01:55:37.443 INFO:teuthology.orchestra.run.smithi073.stdout:(13/33): ceph-common-19.3.0-4854.g8f219c47.el9. 15 MB/s | 22 MB 00:01 2024-09-11T01:55:37.465 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-11T01:55:37.499 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/35 2024-09-11T01:55:37.502 INFO:teuthology.orchestra.run.smithi073.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 366 kB/s | 107 kB 00:00 2024-09-11T01:55:37.531 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-11T01:55:37.553 INFO:teuthology.orchestra.run.smithi073.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-11T01:55:37.562 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T01:55:37.578 INFO:teuthology.orchestra.run.smithi073.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 498 kB/s | 171 kB 00:00 2024-09-11T01:55:37.603 INFO:teuthology.orchestra.run.smithi073.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-11T01:55:37.615 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-11T01:55:37.645 INFO:teuthology.orchestra.run.smithi073.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-11T01:55:37.679 INFO:teuthology.orchestra.run.smithi073.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-11T01:55:37.704 INFO:teuthology.orchestra.run.smithi073.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 420 kB/s | 42 kB 00:00 2024-09-11T01:55:37.729 INFO:teuthology.orchestra.run.smithi073.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-11T01:55:37.755 INFO:teuthology.orchestra.run.smithi073.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-11T01:55:37.780 INFO:teuthology.orchestra.run.smithi073.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-11T01:55:37.830 INFO:teuthology.orchestra.run.smithi073.stdout:(24/33): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.0 MB/s | 309 kB 00:00 2024-09-11T01:55:37.855 INFO:teuthology.orchestra.run.smithi073.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-11T01:55:37.881 INFO:teuthology.orchestra.run.smithi073.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 302 kB/s | 26 kB 00:00 2024-09-11T01:55:37.906 INFO:teuthology.orchestra.run.smithi073.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T01:55:37.940 INFO:teuthology.orchestra.run.smithi073.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T01:55:37.992 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T01:55:37.995 INFO:teuthology.orchestra.run.smithi073.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.2 MB/s | 839 kB 00:00 2024-09-11T01:55:38.032 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 23/35 2024-09-11T01:55:38.057 INFO:teuthology.orchestra.run.smithi073.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-11T01:55:38.114 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 23/35 2024-09-11T01:55:38.145 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 24/35 2024-09-11T01:55:38.149 INFO:teuthology.orchestra.run.smithi073.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-11T01:55:38.189 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T01:55:38.274 INFO:teuthology.orchestra.run.smithi073.stdout:(32/33): librbd1-19.3.0-4854.g8f219c47.el9.x86_ 15 MB/s | 3.2 MB 00:00 2024-09-11T01:55:38.341 INFO:teuthology.orchestra.run.smithi073.stdout:(33/33): librados2-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 3.5 MB 00:00 2024-09-11T01:55:38.346 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:55:38.346 INFO:teuthology.orchestra.run.smithi073.stdout:Total 24 MB/s | 62 MB 00:02 2024-09-11T01:55:38.459 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:55:38.495 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:55:38.495 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:55:38.682 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T01:55:38.718 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 27/35 2024-09-11T01:55:38.798 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 27/35 2024-09-11T01:55:38.876 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 28/35 2024-09-11T01:55:38.979 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x8 29/35 2024-09-11T01:55:39.186 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:55:39.187 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:55:40.733 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:55:40.823 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-11T01:55:40.863 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-11T01:55:40.897 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-11T01:55:40.919 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-11T01:55:40.945 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-11T01:55:41.140 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-11T01:55:41.201 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-11T01:55:41.293 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-11T01:55:41.325 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-11T01:55:41.605 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-11T01:55:41.648 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-11T01:55:41.741 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-11T01:55:41.827 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 8/35 2024-09-11T01:55:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/35 2024-09-11T01:55:41.900 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-11T01:55:41.913 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/35 2024-09-11T01:55:41.938 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 31/35 2024-09-11T01:55:41.949 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-11T01:55:41.993 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9. 11/35 2024-09-11T01:55:42.032 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 31/35 2024-09-11T01:55:42.032 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T01:55:42.033 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T01:55:42.033 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:55:42.056 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-11T01:55:42.062 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 12/35 2024-09-11T01:55:42.096 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 13/35 2024-09-11T01:55:42.160 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 13/35 2024-09-11T01:55:42.203 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-11T01:55:42.313 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-11T01:55:42.354 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-11T01:55:42.396 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-11T01:55:42.428 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/35 2024-09-11T01:55:42.457 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-11T01:55:42.489 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T01:55:42.532 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-11T01:55:42.854 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-11T01:55:42.895 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 23/35 2024-09-11T01:55:42.986 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 23/35 2024-09-11T01:55:43.025 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 24/35 2024-09-11T01:55:43.069 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-11T01:55:43.568 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-11T01:55:43.598 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 27/35 2024-09-11T01:55:43.669 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 27/35 2024-09-11T01:55:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 28/35 2024-09-11T01:55:43.800 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x8 29/35 2024-09-11T01:55:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-11T01:55:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-11T01:55:46.703 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 30/35 2024-09-11T01:55:46.749 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 31/35 2024-09-11T01:55:46.840 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 31/35 2024-09-11T01:55:46.841 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T01:55:46.841 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T01:55:46.841 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:55:46.867 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-11T01:55:52.404 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-11T01:55:52.404 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-09-11T01:55:52.404 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-09-11T01:55:52.404 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-09-11T01:55:52.405 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-09-11T01:55:52.405 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-09-11T01:55:52.405 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-09-11T01:55:52.405 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-09-11T01:55:52.405 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:55:53.449 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 33/35 2024-09-11T01:55:53.476 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 33/35 2024-09-11T01:55:53.476 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:55:53.476 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T01:55:53.476 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T01:55:53.476 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T01:55:53.476 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:55:53.478 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T01:55:53.569 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T01:55:53.569 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T01:55:54.773 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 1/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 3/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 4/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 5/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 6/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9. 8/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x8 9/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 10/35 2024-09-11T01:55:54.774 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 11/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 12/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 13/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T01:55:54.775 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T01:55:54.776 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T01:55:54.776 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T01:55:54.776 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T01:55:54.777 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T01:55:54.777 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T01:55:54.777 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T01:55:54.777 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T01:55:54.777 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-11T01:55:54.777 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T01:55:54.777 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 34/35 2024-09-11T01:55:55.726 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T01:55:55.726 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:55:55.726 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-09-11T01:55:55.726 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.726 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.727 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:55:55.727 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T01:55:55.727 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.727 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.727 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.727 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.727 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T01:55:55.727 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T01:55:55.728 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T01:55:55.728 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.728 INFO:teuthology.orchestra.run.smithi203.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T01:55:55.728 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T01:55:55.728 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T01:55:55.728 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T01:55:55.728 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.728 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T01:55:55.729 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.729 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T01:55:55.729 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T01:55:55.729 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T01:55:55.729 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.729 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.729 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.729 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T01:55:55.730 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.730 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.730 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:55:55.730 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T01:55:55.730 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T01:55:55.730 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T01:55:55.730 INFO:teuthology.orchestra.run.smithi203.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T01:55:55.730 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T01:55:55.731 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:55:55.731 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:55:56.065 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-test 2024-09-11T01:55:56.639 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:28 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:55:56.772 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:55:56.772 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:55:56.772 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:55:56.772 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout:Install 4 Packages 2024-09-11T01:55:56.773 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:55:56.774 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 51 M 2024-09-11T01:55:56.774 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 217 M 2024-09-11T01:55:56.774 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:55:57.195 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-11T01:55:57.195 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-09-11T01:55:57.195 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-09-11T01:55:57.195 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-09-11T01:55:57.195 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-09-11T01:55:57.195 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-09-11T01:55:57.195 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-09-11T01:55:57.195 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-09-11T01:55:57.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:55:57.234 INFO:teuthology.orchestra.run.smithi203.stdout:(1/4): libcephsqlite-19.3.0-4854.g8f219c47.el9. 760 kB/s | 162 kB 00:00 2024-09-11T01:55:57.259 INFO:teuthology.orchestra.run.smithi203.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-11T01:55:57.376 INFO:teuthology.orchestra.run.smithi203.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-11T01:55:58.220 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 33/35 2024-09-11T01:55:58.244 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 33/35 2024-09-11T01:55:58.245 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:55:58.245 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T01:55:58.245 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T01:55:58.245 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T01:55:58.245 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:55:58.247 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T01:55:58.339 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-11T01:55:58.339 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T01:55:58.593 INFO:teuthology.orchestra.run.smithi203.stdout:(4/4): ceph-test-19.3.0-4854.g8f219c47.el9.x86_ 32 MB/s | 50 MB 00:01 2024-09-11T01:55:58.596 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:55:58.596 INFO:teuthology.orchestra.run.smithi203.stdout:Total 28 MB/s | 51 MB 00:01 2024-09-11T01:55:58.624 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:55:58.644 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:55:58.644 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:55:59.040 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:55:59.040 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:55:59.572 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:55:59.588 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T01:55:59.588 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 1/35 2024-09-11T01:55:59.588 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2/35 2024-09-11T01:55:59.588 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 3/35 2024-09-11T01:55:59.589 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 4/35 2024-09-11T01:55:59.592 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 5/35 2024-09-11T01:55:59.592 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_6 6/35 2024-09-11T01:55:59.592 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 7/35 2024-09-11T01:55:59.592 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9. 8/35 2024-09-11T01:55:59.592 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x8 9/35 2024-09-11T01:55:59.592 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 10/35 2024-09-11T01:55:59.592 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 11/35 2024-09-11T01:55:59.592 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 12/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 13/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 24/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-11T01:55:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-11T01:55:59.594 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-11T01:55:59.594 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-11T01:55:59.594 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-11T01:55:59.594 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-11T01:55:59.594 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-11T01:55:59.594 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 32/35 2024-09-11T01:55:59.594 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-11T01:55:59.594 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 34/35 2024-09-11T01:55:59.662 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T01:55:59.710 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T01:55:59.838 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 3/4 2024-09-11T01:56:00.444 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-11T01:56:00.444 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T01:56:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T01:56:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T01:56:00.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:00.448 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:00.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-test 2024-09-11T01:56:01.381 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:28 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:56:01.513 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:56:01.514 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:01.514 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:56:01.514 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:01.514 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:56:01.514 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T01:56:01.514 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-11T01:56:01.515 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T01:56:01.515 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T01:56:01.515 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T01:56:01.515 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:01.515 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:56:01.515 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:01.515 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-09-11T01:56:01.515 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:01.516 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 51 M 2024-09-11T01:56:01.516 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 217 M 2024-09-11T01:56:01.516 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:56:01.735 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): libcephsqlite-19.3.0-4854.g8f219c47.el9. 821 kB/s | 162 kB 00:00 2024-09-11T01:56:01.794 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-11T01:56:01.894 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 401 kB/s | 64 kB 00:00 2024-09-11T01:56:03.086 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): ceph-test-19.3.0-4854.g8f219c47.el9.x86_ 32 MB/s | 50 MB 00:01 2024-09-11T01:56:03.088 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:03.088 INFO:teuthology.orchestra.run.smithi073.stdout:Total 32 MB/s | 51 MB 00:01 2024-09-11T01:56:03.115 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:56:03.135 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:56:03.135 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:56:03.530 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:56:03.530 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:56:04.056 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:56:04.154 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-11T01:56:04.193 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-11T01:56:04.221 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 3/4 2024-09-11T01:56:04.588 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 3/4 2024-09-11T01:56:04.660 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 4/4 2024-09-11T01:56:07.119 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 4/4 2024-09-11T01:56:07.119 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 1/4 2024-09-11T01:56:07.119 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2/4 2024-09-11T01:56:07.119 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T01:56:07.417 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T01:56:07.417 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:07.417 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:56:07.417 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:07.417 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:07.418 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T01:56:07.418 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T01:56:07.418 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:07.418 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:07.687 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph 2024-09-11T01:56:08.291 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:40 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:08.455 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T01:56:08.460 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections 2024-09-11T01:56:08.461 INFO:teuthology.orchestra.run.smithi203.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T01:56:08.462 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout:Install 37 Packages 2024-09-11T01:56:08.463 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:08.464 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 31 M 2024-09-11T01:56:08.464 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 109 M 2024-09-11T01:56:08.464 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:56:08.944 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 3/4 2024-09-11T01:56:09.027 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 4/4 2024-09-11T01:56:09.423 INFO:teuthology.orchestra.run.smithi203.stdout:(1/37): ceph-19.3.0-4854.g8f219c47.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-11T01:56:09.581 INFO:teuthology.orchestra.run.smithi203.stdout:(2/37): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86_ 5.2 MB/s | 1.5 MB 00:00 2024-09-11T01:56:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:(3/37): ceph-mds-19.3.0-4854.g8f219c47.el9.x86_ 6.4 MB/s | 2.4 MB 00:00 2024-09-11T01:56:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4854.g8f21 2.8 MB/s | 291 kB 00:00 2024-09-11T01:56:09.825 INFO:teuthology.orchestra.run.smithi203.stdout:(5/37): ceph-mon-19.3.0-4854.g8f219c47.el9.x86_ 12 MB/s | 4.8 MB 00:00 2024-09-11T01:56:10.174 INFO:teuthology.orchestra.run.smithi203.stdout:(6/37): ceph-osd-19.3.0-4854.g8f219c47.el9.x86_ 29 MB/s | 17 MB 00:00 2024-09-11T01:56:10.508 INFO:teuthology.orchestra.run.smithi203.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 337 kB/s | 253 kB 00:00 2024-09-11T01:56:10.625 INFO:teuthology.orchestra.run.smithi203.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-11T01:56:10.650 INFO:teuthology.orchestra.run.smithi203.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 224 kB/s | 106 kB 00:00 2024-09-11T01:56:10.742 INFO:teuthology.orchestra.run.smithi203.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.0 MB/s | 125 kB 00:00 2024-09-11T01:56:10.851 INFO:teuthology.orchestra.run.smithi203.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.0 MB/s | 215 kB 00:00 2024-09-11T01:56:10.884 INFO:teuthology.orchestra.run.smithi203.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-11T01:56:10.926 INFO:teuthology.orchestra.run.smithi203.stdout:(13/37): python3-cryptography-36.0.1-4.el9.x86_ 1.1 MB/s | 1.2 MB 00:01 2024-09-11T01:56:10.952 INFO:teuthology.orchestra.run.smithi203.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 518 kB/s | 35 kB 00:00 2024-09-11T01:56:10.994 INFO:teuthology.orchestra.run.smithi203.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-11T01:56:11.019 INFO:teuthology.orchestra.run.smithi203.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-11T01:56:11.045 INFO:teuthology.orchestra.run.smithi203.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 656 kB/s | 77 kB 00:00 2024-09-11T01:56:11.070 INFO:teuthology.orchestra.run.smithi203.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-11T01:56:11.120 INFO:teuthology.orchestra.run.smithi203.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-11T01:56:11.145 INFO:teuthology.orchestra.run.smithi203.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-11T01:56:11.179 INFO:teuthology.orchestra.run.smithi203.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 400 kB/s | 43 kB 00:00 2024-09-11T01:56:11.204 INFO:teuthology.orchestra.run.smithi203.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 462 kB/s | 11 kB 00:00 2024-09-11T01:56:11.229 INFO:teuthology.orchestra.run.smithi203.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-11T01:56:11.246 INFO:teuthology.orchestra.run.smithi203.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 421 kB/s | 18 kB 00:00 2024-09-11T01:56:11.263 INFO:teuthology.orchestra.run.smithi203.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 689 kB/s | 23 kB 00:00 2024-09-11T01:56:11.280 INFO:teuthology.orchestra.run.smithi203.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 580 kB/s | 19 kB 00:00 2024-09-11T01:56:11.297 INFO:teuthology.orchestra.run.smithi203.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 585 kB/s | 20 kB 00:00 2024-09-11T01:56:11.314 INFO:teuthology.orchestra.run.smithi203.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-09-11T01:56:11.340 INFO:teuthology.orchestra.run.smithi203.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-11T01:56:11.365 INFO:teuthology.orchestra.run.smithi203.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 657 kB/s | 16 kB 00:00 2024-09-11T01:56:11.399 INFO:teuthology.orchestra.run.smithi203.stdout:(31/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-11T01:56:11.424 INFO:teuthology.orchestra.run.smithi203.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-11T01:56:11.449 INFO:teuthology.orchestra.run.smithi203.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2024-09-11T01:56:11.474 INFO:teuthology.orchestra.run.smithi203.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-11T01:56:11.500 INFO:teuthology.orchestra.run.smithi203.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-11T01:56:11.525 INFO:teuthology.orchestra.run.smithi203.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 397 kB/s | 20 kB 00:00 2024-09-11T01:56:11.558 INFO:teuthology.orchestra.run.smithi203.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-11T01:56:11.564 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:11.564 INFO:teuthology.orchestra.run.smithi203.stdout:Total 9.9 MB/s | 31 MB 00:03 2024-09-11T01:56:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 4/4 2024-09-11T01:56:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 1/4 2024-09-11T01:56:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2/4 2024-09-11T01:56:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-11T01:56:11.716 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:56:11.756 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:56:11.756 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:56:11.977 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-11T01:56:11.977 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:11.977 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:56:11.977 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:11.977 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:11.977 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T01:56:11.977 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T01:56:11.977 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:11.977 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:12.230 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph 2024-09-11T01:56:12.261 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:56:12.261 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:56:12.799 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:39 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:56:12.936 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:56:12.939 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:12.939 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:56:12.939 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:12.939 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:56:12.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T01:56:12.939 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-11T01:56:12.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T01:56:12.939 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T01:56:12.940 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T01:56:12.941 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T01:56:12.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T01:56:12.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T01:56:12.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T01:56:12.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T01:56:12.942 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T01:56:12.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T01:56:12.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T01:56:12.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T01:56:12.944 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T01:56:12.944 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T01:56:12.944 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T01:56:12.944 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:12.944 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:56:12.944 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:12.944 INFO:teuthology.orchestra.run.smithi073.stdout:Install 37 Packages 2024-09-11T01:56:12.944 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:12.945 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 31 M 2024-09-11T01:56:12.945 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 109 M 2024-09-11T01:56:12.945 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:56:13.631 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:56:13.695 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T01:56:13.728 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T01:56:13.765 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T01:56:13.804 INFO:teuthology.orchestra.run.smithi073.stdout:(1/37): ceph-19.3.0-4854.g8f219c47.el9.x86_64.r 38 kB/s | 6.6 kB 00:00 2024-09-11T01:56:13.836 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T01:56:13.889 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T01:56:13.922 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T01:56:14.023 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T01:56:14.101 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T01:56:14.141 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T01:56:14.180 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T01:56:14.210 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T01:56:14.245 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T01:56:14.278 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T01:56:14.319 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T01:56:14.346 INFO:teuthology.orchestra.run.smithi073.stdout:(2/37): ceph-mds-19.3.0-4854.g8f219c47.el9.x86_ 3.3 MB/s | 2.4 MB 00:00 2024-09-11T01:56:14.354 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T01:56:14.397 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T01:56:14.445 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T01:56:14.471 INFO:teuthology.orchestra.run.smithi073.stdout:(3/37): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86_ 1.8 MB/s | 1.5 MB 00:00 2024-09-11T01:56:14.477 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T01:56:14.551 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T01:56:14.646 INFO:teuthology.orchestra.run.smithi073.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4854.g8f21 1.6 MB/s | 291 kB 00:00 2024-09-11T01:56:14.699 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T01:56:14.778 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T01:56:14.831 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T01:56:14.872 INFO:teuthology.orchestra.run.smithi073.stdout:(5/37): ceph-mon-19.3.0-4854.g8f219c47.el9.x86_ 4.5 MB/s | 4.8 MB 00:01 2024-09-11T01:56:14.878 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T01:56:14.908 INFO:teuthology.orchestra.run.smithi073.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 978 kB/s | 253 kB 00:00 2024-09-11T01:56:14.935 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T01:56:14.955 INFO:teuthology.orchestra.run.smithi073.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-11T01:56:14.991 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T01:56:15.039 INFO:teuthology.orchestra.run.smithi073.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-09-11T01:56:15.114 INFO:teuthology.orchestra.run.smithi073.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-09-11T01:56:15.179 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T01:56:15.198 INFO:teuthology.orchestra.run.smithi073.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-11T01:56:15.233 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T01:56:15.316 INFO:teuthology.orchestra.run.smithi073.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-11T01:56:15.319 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T01:56:15.348 INFO:teuthology.orchestra.run.smithi073.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2024-09-11T01:56:15.390 INFO:teuthology.orchestra.run.smithi073.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-11T01:56:15.417 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T01:56:15.432 INFO:teuthology.orchestra.run.smithi073.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-11T01:56:15.458 INFO:teuthology.orchestra.run.smithi073.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 319 kB/s | 35 kB 00:00 2024-09-11T01:56:15.473 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T01:56:15.483 INFO:teuthology.orchestra.run.smithi073.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T01:56:15.508 INFO:teuthology.orchestra.run.smithi073.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-11T01:56:15.559 INFO:teuthology.orchestra.run.smithi073.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-11T01:56:15.584 INFO:teuthology.orchestra.run.smithi073.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-11T01:56:15.603 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T01:56:15.609 INFO:teuthology.orchestra.run.smithi073.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-11T01:56:15.765 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9. 32/37 2024-09-11T01:56:15.785 INFO:teuthology.orchestra.run.smithi073.stdout:(21/37): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 17 MB 00:01 2024-09-11T01:56:15.801 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 33/37 2024-09-11T01:56:15.818 INFO:teuthology.orchestra.run.smithi073.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 734 kB/s | 172 kB 00:00 2024-09-11T01:56:15.828 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 33/37 2024-09-11T01:56:15.828 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:15.828 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T01:56:15.828 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T01:56:15.828 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T01:56:15.828 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:15.852 INFO:teuthology.orchestra.run.smithi073.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 712 kB/s | 18 kB 00:00 2024-09-11T01:56:15.886 INFO:teuthology.orchestra.run.smithi073.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-11T01:56:15.902 INFO:teuthology.orchestra.run.smithi073.stdout:(25/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 97 kB/s | 11 kB 00:00 2024-09-11T01:56:15.919 INFO:teuthology.orchestra.run.smithi073.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 353 kB/s | 23 kB 00:00 2024-09-11T01:56:15.936 INFO:teuthology.orchestra.run.smithi073.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-11T01:56:15.953 INFO:teuthology.orchestra.run.smithi073.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 387 kB/s | 20 kB 00:00 2024-09-11T01:56:15.971 INFO:teuthology.orchestra.run.smithi073.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 915 kB/s | 46 kB 00:00 2024-09-11T01:56:15.995 INFO:teuthology.orchestra.run.smithi073.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-09-11T01:56:16.021 INFO:teuthology.orchestra.run.smithi073.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-11T01:56:16.046 INFO:teuthology.orchestra.run.smithi073.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-11T01:56:16.071 INFO:teuthology.orchestra.run.smithi073.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-11T01:56:16.105 INFO:teuthology.orchestra.run.smithi073.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-11T01:56:16.130 INFO:teuthology.orchestra.run.smithi073.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-11T01:56:16.155 INFO:teuthology.orchestra.run.smithi073.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-09-11T01:56:16.180 INFO:teuthology.orchestra.run.smithi073.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-11T01:56:16.184 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:16.185 INFO:teuthology.orchestra.run.smithi073.stdout:Total 9.5 MB/s | 31 MB 00:03 2024-09-11T01:56:16.330 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:56:16.370 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:56:16.370 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:56:16.859 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:56:16.859 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:56:17.294 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 34/37 2024-09-11T01:56:17.322 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 34/37 2024-09-11T01:56:17.322 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:17.322 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T01:56:17.322 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T01:56:17.322 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T01:56:17.322 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:17.778 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 35/37 2024-09-11T01:56:17.802 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 35/37 2024-09-11T01:56:17.802 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:17.802 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T01:56:17.802 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T01:56:17.802 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T01:56:17.803 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:18.029 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 36/37 2024-09-11T01:56:18.053 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 36/37 2024-09-11T01:56:18.053 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:18.054 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T01:56:18.054 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T01:56:18.054 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T01:56:18.054 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:18.120 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 37/37 2024-09-11T01:56:18.239 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:56:18.309 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-11T01:56:18.345 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-11T01:56:18.381 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-11T01:56:18.454 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-11T01:56:18.514 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-11T01:56:18.546 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-11T01:56:18.639 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-11T01:56:18.726 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-11T01:56:18.766 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-11T01:56:18.801 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-11T01:56:18.831 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-11T01:56:18.865 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-11T01:56:18.898 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-11T01:56:18.939 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-11T01:56:18.993 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-11T01:56:19.026 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-11T01:56:19.074 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-11T01:56:19.106 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-11T01:56:19.180 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-11T01:56:19.318 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-11T01:56:19.398 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-11T01:56:19.450 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-11T01:56:19.497 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-11T01:56:19.555 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-11T01:56:19.610 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-11T01:56:19.799 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-11T01:56:19.845 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-11T01:56:19.924 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-11T01:56:19.999 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 37/37 2024-09-11T01:56:19.999 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/37 2024-09-11T01:56:19.999 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2/37 2024-09-11T01:56:19.999 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 3/37 2024-09-11T01:56:19.999 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 4/37 2024-09-11T01:56:19.999 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 5/37 2024-09-11T01:56:19.999 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9. 6/37 2024-09-11T01:56:19.999 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T01:56:20.000 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T01:56:20.001 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T01:56:20.001 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T01:56:20.001 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T01:56:20.001 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T01:56:20.001 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T01:56:20.001 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T01:56:20.001 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T01:56:20.001 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T01:56:20.002 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T01:56:20.002 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T01:56:20.003 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T01:56:20.003 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T01:56:20.003 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T01:56:20.003 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T01:56:20.003 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T01:56:20.003 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T01:56:20.012 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-11T01:56:20.066 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-11T01:56:20.197 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-11T01:56:20.367 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9. 32/37 2024-09-11T01:56:20.396 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 33/37 2024-09-11T01:56:20.422 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 33/37 2024-09-11T01:56:20.422 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:20.423 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T01:56:20.423 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T01:56:20.423 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T01:56:20.423 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:21.099 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T01:56:21.100 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:21.100 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:56:21.100 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:21.100 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:21.100 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:21.101 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:21.101 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:21.101 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:21.101 INFO:teuthology.orchestra.run.smithi203.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T01:56:21.102 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T01:56:21.102 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T01:56:21.102 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T01:56:21.103 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T01:56:21.103 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T01:56:21.103 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T01:56:21.103 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T01:56:21.104 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T01:56:21.104 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T01:56:21.104 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T01:56:21.104 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T01:56:21.104 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T01:56:21.104 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T01:56:21.104 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T01:56:21.104 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T01:56:21.105 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T01:56:21.106 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T01:56:21.106 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T01:56:21.106 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T01:56:21.106 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T01:56:21.106 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:21.106 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:21.445 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-base 2024-09-11T01:56:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 34/37 2024-09-11T01:56:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 34/37 2024-09-11T01:56:21.917 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:21.917 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T01:56:21.917 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T01:56:21.917 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T01:56:21.917 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:22.019 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:54 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:22.109 INFO:teuthology.orchestra.run.smithi203.stdout:Package ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:56:22.151 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:22.152 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-11T01:56:22.152 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:22.223 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install cephadm 2024-09-11T01:56:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 35/37 2024-09-11T01:56:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 35/37 2024-09-11T01:56:22.397 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:22.397 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T01:56:22.397 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T01:56:22.397 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T01:56:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:22.632 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 36/37 2024-09-11T01:56:22.655 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 36/37 2024-09-11T01:56:22.655 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:22.655 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T01:56:22.656 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T01:56:22.656 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T01:56:22.656 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:22.721 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 37/37 2024-09-11T01:56:22.787 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:54 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:22.921 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:22.922 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:56:22.922 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:22.922 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:56:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T01:56:22.922 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:22.922 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:56:22.923 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:22.923 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-11T01:56:22.923 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:22.923 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 783 k 2024-09-11T01:56:22.923 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 790 k 2024-09-11T01:56:22.923 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:56:23.181 INFO:teuthology.orchestra.run.smithi203.stdout:cephadm-19.3.0-4854.g8f219c47.el9.noarch.rpm 3.0 MB/s | 783 kB 00:00 2024-09-11T01:56:23.181 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:23.182 INFO:teuthology.orchestra.run.smithi203.stdout:Total 3.0 MB/s | 783 kB 00:00 2024-09-11T01:56:23.182 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:56:23.187 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:56:23.187 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:56:23.193 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:56:23.193 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:56:23.264 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:56:23.719 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:56:23.837 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:56:24.202 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:56:24.438 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:56:24.438 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:24.438 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:56:24.438 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:24.438 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:24.439 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:24.518 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 37/37 2024-09-11T01:56:24.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/37 2024-09-11T01:56:24.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2/37 2024-09-11T01:56:24.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 3/37 2024-09-11T01:56:24.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 4/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 5/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9. 6/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-11T01:56:24.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-11T01:56:24.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-11T01:56:24.521 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-11T01:56:24.521 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-11T01:56:24.521 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-11T01:56:24.521 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-11T01:56:24.521 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-11T01:56:24.521 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-11T01:56:24.521 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-11T01:56:24.521 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-11T01:56:24.521 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-11T01:56:24.653 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T01:56:25.231 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:57 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:25.367 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:25.368 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:25.368 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repo Size 2024-09-11T01:56:25.368 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:25.368 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:56:25.368 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T01:56:25.369 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:25.369 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:56:25.369 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:25.369 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-11T01:56:25.369 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:25.369 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 145 k 2024-09-11T01:56:25.369 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 432 k 2024-09-11T01:56:25.369 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:25.485 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T01:56:25.486 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T01:56:25.487 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T01:56:25.488 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T01:56:25.488 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T01:56:25.488 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T01:56:25.488 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:25.488 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:25.581 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-immutable-object-cache-19.3.0-4854.g8f219c 686 kB/s | 145 kB 00:00 2024-09-11T01:56:25.581 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:25.582 INFO:teuthology.orchestra.run.smithi203.stdout:Total 679 kB/s | 145 kB 00:00 2024-09-11T01:56:25.582 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:56:25.589 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:56:25.589 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:56:25.647 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:56:25.647 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:56:25.799 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:56:25.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-base 2024-09-11T01:56:25.873 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-11T01:56:25.900 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-11T01:56:25.900 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:25.900 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T01:56:25.900 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:26.428 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:53 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:56:26.518 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:56:26.560 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:56:26.561 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-11T01:56:26.561 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:26.633 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install cephadm 2024-09-11T01:56:26.864 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-11T01:56:26.864 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:26.864 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:56:26.864 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:26.864 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:26.864 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:27.101 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr 2024-09-11T01:56:27.187 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:54 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:56:27.318 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:56:27.319 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:27.319 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:56:27.319 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:27.319 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:56:27.319 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T01:56:27.319 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:27.320 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:56:27.320 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:27.320 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-11T01:56:27.320 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:27.320 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 783 k 2024-09-11T01:56:27.320 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 790 k 2024-09-11T01:56:27.320 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:56:27.589 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm-19.3.0-4854.g8f219c47.el9.noarch.rpm 2.8 MB/s | 783 kB 00:00 2024-09-11T01:56:27.589 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:27.590 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.8 MB/s | 783 kB 00:00 2024-09-11T01:56:27.590 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:56:27.595 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:56:27.595 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:56:27.601 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:56:27.601 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:56:27.675 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:00:59 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:27.676 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:56:27.769 INFO:teuthology.orchestra.run.smithi203.stdout:Package ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:56:27.810 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:27.811 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-11T01:56:27.811 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:27.884 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T01:56:28.151 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:56:28.242 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:56:28.452 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:00 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:28.590 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:28.591 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:28.591 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:56:28.591 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:28.591 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:56:28.591 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T01:56:28.591 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-11T01:56:28.591 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T01:56:28.592 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T01:56:28.592 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T01:56:28.592 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T01:56:28.592 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T01:56:28.592 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T01:56:28.592 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T01:56:28.592 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T01:56:28.593 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T01:56:28.593 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T01:56:28.593 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T01:56:28.593 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:28.593 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:56:28.593 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:28.594 INFO:teuthology.orchestra.run.smithi203.stdout:Install 12 Packages 2024-09-11T01:56:28.594 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:28.594 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 19 M 2024-09-11T01:56:28.594 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 159 M 2024-09-11T01:56:28.594 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:56:28.626 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:56:28.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:56:28.866 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:56:28.866 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:28.866 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:28.866 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:29.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-immutable-object-cache 2024-09-11T01:56:29.277 INFO:teuthology.orchestra.run.smithi203.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4854.g8f 237 kB/s | 34 kB 00:00 2024-09-11T01:56:29.303 INFO:teuthology.orchestra.run.smithi203.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4854.g8f2 97 kB/s | 16 kB 00:00 2024-09-11T01:56:29.436 INFO:teuthology.orchestra.run.smithi203.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-11T01:56:29.495 INFO:teuthology.orchestra.run.smithi203.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-11T01:56:29.545 INFO:teuthology.orchestra.run.smithi203.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 7.8 MB/s | 863 kB 00:00 2024-09-11T01:56:29.588 INFO:teuthology.orchestra.run.smithi203.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 464 kB/s | 19 kB 00:00 2024-09-11T01:56:29.613 INFO:teuthology.orchestra.run.smithi203.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.5 MB/s | 548 kB 00:00 2024-09-11T01:56:29.630 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:56 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:56:29.646 INFO:teuthology.orchestra.run.smithi203.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-11T01:56:29.672 INFO:teuthology.orchestra.run.smithi203.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-11T01:56:29.706 INFO:teuthology.orchestra.run.smithi203.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-11T01:56:29.756 INFO:teuthology.orchestra.run.smithi203.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2024-09-11T01:56:29.764 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:56:29.765 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:29.765 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-11T01:56:29.765 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:29.765 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:56:29.765 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T01:56:29.765 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:29.766 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:56:29.766 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:29.766 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-11T01:56:29.766 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:29.766 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 145 k 2024-09-11T01:56:29.766 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 432 k 2024-09-11T01:56:29.766 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:56:29.945 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-immutable-object-cache-19.3.0-4854.g8f219c 809 kB/s | 145 kB 00:00 2024-09-11T01:56:29.946 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:29.946 INFO:teuthology.orchestra.run.smithi073.stdout:Total 801 kB/s | 145 kB 00:00 2024-09-11T01:56:29.947 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:56:29.954 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:56:29.954 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:56:30.012 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:56:30.013 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:56:30.148 INFO:teuthology.orchestra.run.smithi203.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4854.g8f219c 14 MB/s | 14 MB 00:01 2024-09-11T01:56:30.152 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:30.152 INFO:teuthology.orchestra.run.smithi203.stdout:Total 12 MB/s | 19 MB 00:01 2024-09-11T01:56:30.153 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:56:30.201 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:56:30.221 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:56:30.221 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:56:30.230 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-11T01:56:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-11T01:56:30.254 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:56:30.255 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T01:56:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:30.490 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:56:30.491 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:56:31.094 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:56:31.173 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-11T01:56:31.207 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47. 1/1 2024-09-11T01:56:31.208 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:31.208 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:56:31.208 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:56:31.208 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:31.208 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:31.217 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-11T01:56:31.264 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-11T01:56:31.294 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-11T01:56:31.391 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-11T01:56:31.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr 2024-09-11T01:56:31.521 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-11T01:56:31.664 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-11T01:56:31.716 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-11T01:56:31.745 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-11T01:56:31.777 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9 10/12 2024-09-11T01:56:32.021 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:59 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:56:32.111 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:56:32.152 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:56:32.153 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-11T01:56:32.153 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:32.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-dashboard 2024-09-11T01:56:32.777 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:59 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:56:32.910 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:56:32.911 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T01:56:32.912 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T01:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T01:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T01:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout:Install 12 Packages 2024-09-11T01:56:32.913 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 19 M 2024-09-11T01:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 159 M 2024-09-11T01:56:32.914 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:56:33.549 INFO:teuthology.orchestra.run.smithi073.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4854.g8f 221 kB/s | 34 kB 00:00 2024-09-11T01:56:33.565 INFO:teuthology.orchestra.run.smithi073.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4854.g8f2 96 kB/s | 16 kB 00:00 2024-09-11T01:56:33.791 INFO:teuthology.orchestra.run.smithi073.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-09-11T01:56:33.858 INFO:teuthology.orchestra.run.smithi073.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.3 MB/s | 1.0 MB 00:00 2024-09-11T01:56:33.908 INFO:teuthology.orchestra.run.smithi073.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-11T01:56:33.933 INFO:teuthology.orchestra.run.smithi073.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 787 kB/s | 19 kB 00:00 2024-09-11T01:56:34.009 INFO:teuthology.orchestra.run.smithi073.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-11T01:56:34.043 INFO:teuthology.orchestra.run.smithi073.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.3 MB/s | 144 kB 00:00 2024-09-11T01:56:34.076 INFO:teuthology.orchestra.run.smithi073.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.0 MB/s | 863 kB 00:00 2024-09-11T01:56:34.101 INFO:teuthology.orchestra.run.smithi073.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 526 kB/s | 31 kB 00:00 2024-09-11T01:56:34.144 INFO:teuthology.orchestra.run.smithi073.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-11T01:56:34.294 INFO:teuthology.orchestra.run.smithi073.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4854.g8f219c 16 MB/s | 14 MB 00:00 2024-09-11T01:56:34.298 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:34.298 INFO:teuthology.orchestra.run.smithi073.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-11T01:56:34.350 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:56:34.371 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:56:34.371 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:56:34.638 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:56:34.638 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:56:34.977 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el 11/12 2024-09-11T01:56:35.032 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 12/12 2024-09-11T01:56:35.241 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:56:35.311 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-11T01:56:35.346 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-11T01:56:35.393 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-11T01:56:35.433 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-11T01:56:35.541 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-11T01:56:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-11T01:56:35.754 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-11T01:56:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-11T01:56:35.867 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-11T01:56:35.899 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9 10/12 2024-09-11T01:56:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 12/12 2024-09-11T01:56:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el 1/12 2024-09-11T01:56:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 2/12 2024-09-11T01:56:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9 3/12 2024-09-11T01:56:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-11T01:56:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-11T01:56:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-11T01:56:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-11T01:56:36.912 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-11T01:56:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-11T01:56:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-11T01:56:36.913 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-11T01:56:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-11T01:56:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:37.228 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:56:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T01:56:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:37.229 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:37.494 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T01:56:38.074 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:10 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:38.217 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:38.218 INFO:teuthology.orchestra.run.smithi203.stdout:======================================================================================= 2024-09-11T01:56:38.218 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:56:38.218 INFO:teuthology.orchestra.run.smithi203.stdout:======================================================================================= 2024-09-11T01:56:38.218 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:56:38.218 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T01:56:38.218 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:56:38.219 INFO:teuthology.orchestra.run.smithi203.stdout:======================================================================================= 2024-09-11T01:56:38.220 INFO:teuthology.orchestra.run.smithi203.stdout:Install 12 Packages 2024-09-11T01:56:38.220 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:38.220 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 38 M 2024-09-11T01:56:38.220 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 212 M 2024-09-11T01:56:38.220 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:56:38.583 INFO:teuthology.orchestra.run.smithi203.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-11T01:56:38.650 INFO:teuthology.orchestra.run.smithi203.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-11T01:56:38.683 INFO:teuthology.orchestra.run.smithi203.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 328 kB/s | 33 kB 00:00 2024-09-11T01:56:38.734 INFO:teuthology.orchestra.run.smithi203.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-11T01:56:38.793 INFO:teuthology.orchestra.run.smithi203.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-11T01:56:38.943 INFO:teuthology.orchestra.run.smithi203.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-48 15 MB/s | 7.4 MB 00:00 2024-09-11T01:56:39.026 INFO:teuthology.orchestra.run.smithi203.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.9 MB/s | 3.0 MB 00:00 2024-09-11T01:56:39.087 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el 11/12 2024-09-11T01:56:39.135 INFO:teuthology.orchestra.run.smithi203.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-11T01:56:39.145 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 12/12 2024-09-11T01:56:39.210 INFO:teuthology.orchestra.run.smithi203.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-11T01:56:39.236 INFO:teuthology.orchestra.run.smithi203.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.4 MB/s | 250 kB 00:00 2024-09-11T01:56:39.519 INFO:teuthology.orchestra.run.smithi203.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 53 MB/s | 16 MB 00:00 2024-09-11T01:56:39.603 INFO:teuthology.orchestra.run.smithi203.stdout:(12/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 6.1 MB/s | 4.9 MB 00:00 2024-09-11T01:56:39.604 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:39.604 INFO:teuthology.orchestra.run.smithi203.stdout:Total 28 MB/s | 38 MB 00:01 2024-09-11T01:56:39.956 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:56:39.982 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:56:39.982 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:56:40.416 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:56:40.416 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:56:41.107 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 12/12 2024-09-11T01:56:41.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el 1/12 2024-09-11T01:56:41.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noa 2/12 2024-09-11T01:56:41.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9 3/12 2024-09-11T01:56:41.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-11T01:56:41.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-11T01:56:41.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-11T01:56:41.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-11T01:56:41.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-11T01:56:41.108 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-11T01:56:41.110 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-11T01:56:41.110 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-11T01:56:41.183 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:56:41.257 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T01:56:41.302 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T01:56:41.410 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T01:56:41.445 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T01:56:41.452 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T01:56:41.453 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T01:56:41.454 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T01:56:41.454 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T01:56:41.454 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T01:56:41.454 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:41.454 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:41.629 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T01:56:41.660 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T01:56:41.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-11T01:56:41.736 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T01:56:42.259 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:09 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:56:42.392 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:56:42.393 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-11T01:56:42.393 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:56:42.393 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T01:56:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T01:56:42.395 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T01:56:42.395 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:42.395 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:56:42.395 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-11T01:56:42.395 INFO:teuthology.orchestra.run.smithi073.stdout:Install 12 Packages 2024-09-11T01:56:42.395 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:42.395 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T01:56:42.396 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 38 M 2024-09-11T01:56:42.396 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 212 M 2024-09-11T01:56:42.396 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:56:42.516 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T01:56:43.245 INFO:teuthology.orchestra.run.smithi073.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-48 17 MB/s | 7.4 MB 00:00 2024-09-11T01:56:43.361 INFO:teuthology.orchestra.run.smithi073.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 340 kB/s | 191 kB 00:00 2024-09-11T01:56:43.512 INFO:teuthology.orchestra.run.smithi073.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 123 kB/s | 33 kB 00:00 2024-09-11T01:56:43.766 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T01:56:43.779 INFO:teuthology.orchestra.run.smithi073.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 68 kB/s | 18 kB 00:00 2024-09-11T01:56:43.812 INFO:teuthology.orchestra.run.smithi073.stdout:(5/12): libgfortran-11.5.0-2.el9.x86_64.rpm 791 kB/s | 801 kB 00:01 2024-09-11T01:56:44.037 INFO:teuthology.orchestra.run.smithi073.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 149 kB/s | 38 kB 00:00 2024-09-11T01:56:44.263 INFO:teuthology.orchestra.run.smithi073.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2024-09-11T01:56:44.541 INFO:teuthology.orchestra.run.smithi073.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 486 kB/s | 245 kB 00:00 2024-09-11T01:56:44.747 INFO:teuthology.orchestra.run.smithi073.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 5.3 MB/s | 4.9 MB 00:00 2024-09-11T01:56:44.809 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T01:56:44.837 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 12/12 2024-09-11T01:56:45.064 INFO:teuthology.orchestra.run.smithi073.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 479 kB/s | 250 kB 00:00 2024-09-11T01:56:45.223 INFO:teuthology.orchestra.run.smithi073.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.3 MB/s | 5.1 MB 00:00 2024-09-11T01:56:46.064 INFO:teuthology.orchestra.run.smithi073.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-11T01:56:46.065 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:46.066 INFO:teuthology.orchestra.run.smithi073.stdout:Total 10 MB/s | 38 MB 00:03 2024-09-11T01:56:46.426 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:56:46.452 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:56:46.452 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:56:46.879 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:56:46.879 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:56:47.474 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 12/12 2024-09-11T01:56:47.474 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 1/12 2024-09-11T01:56:47.474 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T01:56:47.474 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T01:56:47.474 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T01:56:47.474 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T01:56:47.474 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T01:56:47.474 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T01:56:47.474 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T01:56:47.475 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T01:56:47.475 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T01:56:47.475 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T01:56:47.677 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:56:47.745 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-11T01:56:47.798 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-11T01:56:47.896 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T01:56:47.896 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:47.896 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:56:47.896 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:47.896 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T01:56:47.896 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T01:56:47.896 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T01:56:47.896 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T01:56:47.896 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T01:56:47.897 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T01:56:47.897 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T01:56:47.897 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T01:56:47.897 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T01:56:47.897 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T01:56:47.897 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T01:56:47.897 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:47.897 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:47.897 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-11T01:56:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-11T01:56:48.122 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-11T01:56:48.154 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-11T01:56:48.230 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-11T01:56:48.298 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-rook 2024-09-11T01:56:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-11T01:56:48.883 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:20 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:49.000 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-11T01:56:49.019 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:49.021 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:49.021 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:56:49.021 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:49.021 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:56:49.021 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T01:56:49.021 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-11T01:56:49.021 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T01:56:49.021 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T01:56:49.021 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout:Install 13 Packages 2024-09-11T01:56:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:49.023 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 2.2 M 2024-09-11T01:56:49.023 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 26 M 2024-09-11T01:56:49.023 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:56:49.206 INFO:teuthology.orchestra.run.smithi203.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 210 kB/s | 19 kB 00:00 2024-09-11T01:56:49.231 INFO:teuthology.orchestra.run.smithi203.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 220 kB/s | 26 kB 00:00 2024-09-11T01:56:49.340 INFO:teuthology.orchestra.run.smithi203.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-11T01:56:49.365 INFO:teuthology.orchestra.run.smithi203.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T01:56:49.399 INFO:teuthology.orchestra.run.smithi203.stdout:(5/13): ceph-mgr-rook-19.3.0-4854.g8f219c47.el9 173 kB/s | 49 kB 00:00 2024-09-11T01:56:49.424 INFO:teuthology.orchestra.run.smithi203.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 919 kB/s | 54 kB 00:00 2024-09-11T01:56:49.466 INFO:teuthology.orchestra.run.smithi203.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.2 MB/s | 279 kB 00:00 2024-09-11T01:56:49.491 INFO:teuthology.orchestra.run.smithi203.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-11T01:56:49.525 INFO:teuthology.orchestra.run.smithi203.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-11T01:56:49.550 INFO:teuthology.orchestra.run.smithi203.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-11T01:56:49.567 INFO:teuthology.orchestra.run.smithi203.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 5.3 MB/s | 90 kB 00:00 2024-09-11T01:56:49.601 INFO:teuthology.orchestra.run.smithi203.stdout:(12/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-11T01:56:49.643 INFO:teuthology.orchestra.run.smithi203.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.1 MB/s | 1.0 MB 00:00 2024-09-11T01:56:49.645 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:49.645 INFO:teuthology.orchestra.run.smithi203.stdout:Total 3.6 MB/s | 2.2 MB 00:00 2024-09-11T01:56:49.707 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:56:49.723 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:56:49.723 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:56:49.811 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:56:49.812 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:56:50.227 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T01:56:50.318 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:56:50.489 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T01:56:50.544 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T01:56:50.600 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T01:56:50.637 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T01:56:50.678 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T01:56:50.780 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T01:56:50.882 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T01:56:50.939 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T01:56:51.270 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-11T01:56:51.295 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 12/12 2024-09-11T01:56:51.656 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T01:56:51.704 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T01:56:51.737 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T01:56:51.785 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T01:56:51.807 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 13/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 13/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 1/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T01:56:52.637 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T01:56:52.638 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T01:56:52.638 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T01:56:52.975 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T01:56:52.976 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T01:56:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T01:56:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T01:56:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T01:56:52.977 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:52.977 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:53.251 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T01:56:53.818 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:25 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:53.952 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T01:56:53.953 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T01:56:53.954 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T01:56:53.954 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:53.954 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:56:53.954 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:53.954 INFO:teuthology.orchestra.run.smithi203.stdout:Install 6 Packages 2024-09-11T01:56:53.954 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:53.954 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 7.0 M 2024-09-11T01:56:53.955 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 33 M 2024-09-11T01:56:53.955 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 12/12 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219 1/12 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-11T01:56:53.970 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-11T01:56:53.971 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-11T01:56:53.971 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-11T01:56:54.255 INFO:teuthology.orchestra.run.smithi203.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4854.g8f219c47.e 723 kB/s | 154 kB 00:00 2024-09-11T01:56:54.281 INFO:teuthology.orchestra.run.smithi203.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-11T01:56:54.331 INFO:teuthology.orchestra.run.smithi203.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-11T01:56:54.356 INFO:teuthology.orchestra.run.smithi203.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 765 kB/s | 58 kB 00:00 2024-09-11T01:56:54.381 INFO:teuthology.orchestra.run.smithi203.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T01:56:54.383 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T01:56:54.384 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T01:56:54.384 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T01:56:54.384 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:54.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-rook 2024-09-11T01:56:55.379 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:22 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:56:55.511 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:56:55.512 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:55.512 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:56:55.512 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:55.512 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:56:55.512 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T01:56:55.512 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-11T01:56:55.512 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T01:56:55.512 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:56:55.513 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:56:55.514 INFO:teuthology.orchestra.run.smithi073.stdout:Install 13 Packages 2024-09-11T01:56:55.514 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:55.514 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.2 M 2024-09-11T01:56:55.514 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 26 M 2024-09-11T01:56:55.514 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:56:55.804 INFO:teuthology.orchestra.run.smithi073.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 218 kB/s | 19 kB 00:00 2024-09-11T01:56:55.821 INFO:teuthology.orchestra.run.smithi073.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 244 kB/s | 26 kB 00:00 2024-09-11T01:56:55.888 INFO:teuthology.orchestra.run.smithi073.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-09-11T01:56:55.913 INFO:teuthology.orchestra.run.smithi073.stdout:(4/13): ceph-mgr-rook-19.3.0-4854.g8f219c47.el9 250 kB/s | 49 kB 00:00 2024-09-11T01:56:55.947 INFO:teuthology.orchestra.run.smithi073.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T01:56:55.972 INFO:teuthology.orchestra.run.smithi073.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.2 MB/s | 279 kB 00:00 2024-09-11T01:56:56.014 INFO:teuthology.orchestra.run.smithi073.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-11T01:56:56.039 INFO:teuthology.orchestra.run.smithi073.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 425 kB/s | 54 kB 00:00 2024-09-11T01:56:56.065 INFO:teuthology.orchestra.run.smithi073.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 165 kB/s | 14 kB 00:00 2024-09-11T01:56:56.098 INFO:teuthology.orchestra.run.smithi073.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-11T01:56:56.124 INFO:teuthology.orchestra.run.smithi073.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-11T01:56:56.149 INFO:teuthology.orchestra.run.smithi073.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-11T01:56:56.191 INFO:teuthology.orchestra.run.smithi073.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-11T01:56:56.193 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:56.193 INFO:teuthology.orchestra.run.smithi073.stdout:Total 3.3 MB/s | 2.2 MB 00:00 2024-09-11T01:56:56.253 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:56:56.268 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:56:56.268 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:56:56.356 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:56:56.357 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:56:56.448 INFO:teuthology.orchestra.run.smithi203.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.5 MB/s | 6.0 MB 00:02 2024-09-11T01:56:56.450 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:56:56.450 INFO:teuthology.orchestra.run.smithi203.stdout:Total 2.8 MB/s | 7.0 MB 00:02 2024-09-11T01:56:56.520 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:56:56.531 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:56:56.531 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:56:56.631 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:56:56.631 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:56:56.887 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:56:56.955 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:56:57.061 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-11T01:56:57.116 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-11T01:56:57.130 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T01:56:57.179 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-11T01:56:57.183 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T01:56:57.218 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-11T01:56:57.259 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-11T01:56:57.368 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-11T01:56:57.469 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-11T01:56:57.527 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-11T01:56:57.708 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T01:56:57.794 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T01:56:57.870 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T01:56:57.896 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 6/6 2024-09-11T01:56:58.239 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-11T01:56:58.300 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-11T01:56:58.334 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-11T01:56:58.381 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-11T01:56:58.404 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 13/13 2024-09-11T01:56:58.609 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 6/6 2024-09-11T01:56:58.609 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/6 2024-09-11T01:56:58.609 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T01:56:58.609 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T01:56:58.609 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T01:56:58.609 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T01:56:58.892 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T01:56:58.892 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:58.892 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:56:58.892 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:58.892 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T01:56:58.892 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T01:56:58.892 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T01:56:58.892 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T01:56:58.893 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T01:56:58.893 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:58.893 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 13/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 1/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-11T01:56:59.139 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-11T01:56:59.171 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-fuse 2024-09-11T01:56:59.470 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-11T01:56:59.470 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T01:56:59.471 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T01:56:59.472 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T01:56:59.472 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:56:59.472 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:56:59.745 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:56:59.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-cephadm 2024-09-11T01:56:59.878 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:56:59.878 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:59.878 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:56:59.878 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:59.879 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:56:59.879 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T01:56:59.879 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-11T01:56:59.879 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T01:56:59.879 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:59.879 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:56:59.879 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:56:59.879 INFO:teuthology.orchestra.run.smithi203.stdout:Install 2 Packages 2024-09-11T01:56:59.879 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:56:59.880 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 980 k 2024-09-11T01:56:59.880 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 2.9 M 2024-09-11T01:56:59.880 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:57:00.126 INFO:teuthology.orchestra.run.smithi203.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 625 kB/s | 80 kB 00:00 2024-09-11T01:57:00.301 INFO:teuthology.orchestra.run.smithi203.stdout:(2/2): ceph-fuse-19.3.0-4854.g8f219c47.el9.x86_ 2.9 MB/s | 900 kB 00:00 2024-09-11T01:57:00.302 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:00.302 INFO:teuthology.orchestra.run.smithi203.stdout:Total 2.3 MB/s | 980 kB 00:00 2024-09-11T01:57:00.310 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:27 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:00.314 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:57:00.336 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:57:00.336 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:57:00.417 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:57:00.418 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:57:00.444 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:00.444 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T01:57:00.445 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T01:57:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:00.446 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:57:00.446 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:00.446 INFO:teuthology.orchestra.run.smithi073.stdout:Install 6 Packages 2024-09-11T01:57:00.446 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:00.449 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 7.0 M 2024-09-11T01:57:00.449 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 33 M 2024-09-11T01:57:00.449 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:57:00.605 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:57:00.744 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T01:57:00.809 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2/2 2024-09-11T01:57:00.943 INFO:teuthology.orchestra.run.smithi073.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4854.g8f219c47.e 699 kB/s | 154 kB 00:00 2024-09-11T01:57:00.993 INFO:teuthology.orchestra.run.smithi073.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-11T01:57:01.018 INFO:teuthology.orchestra.run.smithi073.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-11T01:57:01.043 INFO:teuthology.orchestra.run.smithi073.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-11T01:57:01.277 INFO:teuthology.orchestra.run.smithi073.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 447 kB/s | 248 kB 00:00 2024-09-11T01:57:01.485 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2/2 2024-09-11T01:57:01.485 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/2 2024-09-11T01:57:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T01:57:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:01.747 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:57:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T01:57:01.747 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:01.747 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:01.944 INFO:teuthology.orchestra.run.smithi073.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-09-11T01:57:01.946 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:01.946 INFO:teuthology.orchestra.run.smithi073.stdout:Total 4.7 MB/s | 7.0 MB 00:01 2024-09-11T01:57:02.015 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-volume 2024-09-11T01:57:02.016 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:57:02.027 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:57:02.027 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:57:02.128 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:57:02.128 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:57:02.459 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:57:02.598 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-11T01:57:02.696 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-11T01:57:02.738 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:02.739 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:02.739 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-11T01:57:02.739 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:02.739 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:57:02.739 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T01:57:02.739 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:02.739 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:57:02.739 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:02.739 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-11T01:57:02.740 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:02.740 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 285 k 2024-09-11T01:57:02.740 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 1.3 M 2024-09-11T01:57:02.740 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:57:02.941 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-volume-19.3.0-4854.g8f219c47.el9.noarch.rp 1.4 MB/s | 285 kB 00:00 2024-09-11T01:57:02.942 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:02.942 INFO:teuthology.orchestra.run.smithi203.stdout:Total 1.4 MB/s | 285 kB 00:00 2024-09-11T01:57:02.942 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:57:02.951 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:57:02.951 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:57:02.979 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:57:02.979 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:57:03.196 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:57:03.235 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-11T01:57:03.269 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:57:03.285 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:57:03.285 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:57:03.286 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T01:57:03.286 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:03.324 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-11T01:57:03.400 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-11T01:57:03.425 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 6/6 2024-09-11T01:57:04.215 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 6/6 2024-09-11T01:57:04.215 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 1/6 2024-09-11T01:57:04.215 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-11T01:57:04.215 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-11T01:57:04.215 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-11T01:57:04.215 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-11T01:57:04.255 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:57:04.255 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:04.256 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:57:04.256 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:57:04.256 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:04.256 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T01:57:04.494 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:04.495 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:04.565 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install librados-devel 2024-09-11T01:57:04.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-fuse 2024-09-11T01:57:05.145 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:05.284 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:05.285 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:05.285 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repo Size 2024-09-11T01:57:05.285 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:05.285 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:57:05.286 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T01:57:05.286 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:05.286 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:57:05.286 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:05.286 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-11T01:57:05.286 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:05.286 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 127 k 2024-09-11T01:57:05.286 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 456 k 2024-09-11T01:57:05.286 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:57:05.314 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:32 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:05.448 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T01:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-11T01:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T01:57:05.449 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout:Install 2 Packages 2024-09-11T01:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 980 k 2024-09-11T01:57:05.450 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 2.9 M 2024-09-11T01:57:05.451 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:57:05.473 INFO:teuthology.orchestra.run.smithi203.stdout:librados-devel-19.3.0-4854.g8f219c47.el9.x86_64 678 kB/s | 127 kB 00:00 2024-09-11T01:57:05.473 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:05.474 INFO:teuthology.orchestra.run.smithi203.stdout:Total 673 kB/s | 127 kB 00:00 2024-09-11T01:57:05.474 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:57:05.479 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:57:05.479 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:57:05.548 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:57:05.548 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:57:05.702 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:57:05.755 INFO:teuthology.orchestra.run.smithi073.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 436 kB/s | 80 kB 00:00 2024-09-11T01:57:05.821 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:05.846 INFO:teuthology.orchestra.run.smithi073.stdout:(2/2): ceph-fuse-19.3.0-4854.g8f219c47.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-11T01:57:05.847 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:05.847 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.4 MB/s | 980 kB 00:00 2024-09-11T01:57:05.859 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:57:05.880 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:57:05.962 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:57:05.963 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:57:06.162 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:57:06.265 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-11T01:57:06.371 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2/2 2024-09-11T01:57:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:06.507 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:06.507 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:57:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:06.508 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:06.508 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:06.786 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install libcephfs2 2024-09-11T01:57:07.037 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2/2 2024-09-11T01:57:07.038 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/2 2024-09-11T01:57:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-11T01:57:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:07.318 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:57:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-11T01:57:07.318 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:07.318 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:07.373 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:39 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:07.470 INFO:teuthology.orchestra.run.smithi203.stdout:Package libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:07.517 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:07.518 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-11T01:57:07.518 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:07.587 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install libcephfs-devel 2024-09-11T01:57:07.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-volume 2024-09-11T01:57:08.185 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:08.187 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:08.322 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:08.323 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-11T01:57:08.323 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:08.323 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:57:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T01:57:08.323 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:08.323 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:57:08.323 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:08.323 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-11T01:57:08.324 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:08.324 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 285 k 2024-09-11T01:57:08.324 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 1.3 M 2024-09-11T01:57:08.324 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:57:08.324 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:08.325 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:08.325 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repo Size 2024-09-11T01:57:08.325 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:08.325 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:57:08.325 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T01:57:08.325 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:08.325 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:57:08.325 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:08.325 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-11T01:57:08.326 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:08.326 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 32 k 2024-09-11T01:57:08.326 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 142 k 2024-09-11T01:57:08.326 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:57:08.479 INFO:teuthology.orchestra.run.smithi203.stdout:libcephfs-devel-19.3.0-4854.g8f219c47.el9.x86_6 209 kB/s | 32 kB 00:00 2024-09-11T01:57:08.479 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:08.480 INFO:teuthology.orchestra.run.smithi203.stdout:Total 206 kB/s | 32 kB 00:00 2024-09-11T01:57:08.480 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:57:08.484 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:57:08.484 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:57:08.496 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:57:08.497 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-volume-19.3.0-4854.g8f219c47.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-11T01:57:08.560 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-11T01:57:08.561 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:57:08.569 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:57:08.585 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:57:08.599 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:57:08.693 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:08.818 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:57:08.887 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:57:08.903 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:57:08.903 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:57:08.903 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T01:57:08.903 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:09.084 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:09.314 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:09.314 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:09.314 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:57:09.314 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:09.314 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:09.314 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:09.499 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install librados2 2024-09-11T01:57:09.876 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 1/1 2024-09-11T01:57:09.877 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:09.877 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:57:09.877 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T01:57:09.877 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:09.877 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:10.070 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:42 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:10.161 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:10.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados-devel 2024-09-11T01:57:10.204 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:10.205 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-11T01:57:10.205 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:10.281 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install librbd1 2024-09-11T01:57:10.782 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:10.850 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:42 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:10.918 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:10.919 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:10.919 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-11T01:57:10.919 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 127 k 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 456 k 2024-09-11T01:57:10.920 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:57:10.942 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:10.985 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:10.986 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-11T01:57:10.986 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:11.059 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-rados 2024-09-11T01:57:11.132 INFO:teuthology.orchestra.run.smithi073.stdout:librados-devel-19.3.0-4854.g8f219c47.el9.x86_64 598 kB/s | 127 kB 00:00 2024-09-11T01:57:11.133 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:11.133 INFO:teuthology.orchestra.run.smithi073.stdout:Total 593 kB/s | 127 kB 00:00 2024-09-11T01:57:11.133 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:57:11.139 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:57:11.139 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:57:11.207 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:57:11.208 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:57:11.363 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:57:11.480 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:11.631 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:43 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:11.722 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:11.765 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:11.766 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-11T01:57:11.766 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:11.832 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-rgw 2024-09-11T01:57:11.939 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:12.253 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:12.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:12.254 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:57:12.254 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:12.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:12.254 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:12.403 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:44 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:12.494 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:12.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs2 2024-09-11T01:57:12.537 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:12.538 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-11T01:57:12.538 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:12.607 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-cephfs 2024-09-11T01:57:13.092 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:13.179 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:45 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:13.185 INFO:teuthology.orchestra.run.smithi073.stdout:Package libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:13.231 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:13.232 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-11T01:57:13.232 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:13.269 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:13.312 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:13.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs-devel 2024-09-11T01:57:13.316 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-11T01:57:13.316 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:13.393 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install python3-rbd 2024-09-11T01:57:13.878 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:13.963 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:45 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:14.012 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:14.012 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-11T01:57:14.012 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:14.012 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:57:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T01:57:14.012 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:14.012 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:57:14.013 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:14.013 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-11T01:57:14.013 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:14.013 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 32 k 2024-09-11T01:57:14.013 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 142 k 2024-09-11T01:57:14.013 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:57:14.055 INFO:teuthology.orchestra.run.smithi203.stdout:Package python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:14.098 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:14.099 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-09-11T01:57:14.099 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:14.161 INFO:teuthology.orchestra.run.smithi073.stdout:libcephfs-devel-19.3.0-4854.g8f219c47.el9.x86_6 215 kB/s | 32 kB 00:00 2024-09-11T01:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout:Total 212 kB/s | 32 kB 00:00 2024-09-11T01:57:14.162 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:57:14.166 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:57:14.167 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install rbd-fuse 2024-09-11T01:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:57:14.179 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:57:14.273 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:57:14.376 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:14.731 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:46 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:14.864 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:14.865 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-11T01:57:14.865 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:14.865 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:57:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T01:57:14.865 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:14.865 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:57:14.866 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:14.866 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-11T01:57:14.866 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:14.866 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 85 k 2024-09-11T01:57:14.866 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 231 k 2024-09-11T01:57:14.866 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:57:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:15.025 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:57:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:15.025 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:15.025 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:15.066 INFO:teuthology.orchestra.run.smithi203.stdout:rbd-fuse-19.3.0-4854.g8f219c47.el9.x86_64.rpm 426 kB/s | 85 kB 00:00 2024-09-11T01:57:15.066 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:15.066 INFO:teuthology.orchestra.run.smithi203.stdout:Total 423 kB/s | 85 kB 00:00 2024-09-11T01:57:15.067 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:57:15.073 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:57:15.073 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:57:15.137 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:57:15.138 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:57:15.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados2 2024-09-11T01:57:15.294 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:57:15.388 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:15.780 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:42 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:15.810 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:15.869 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:15.912 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:15.913 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-11T01:57:15.913 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:15.975 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librbd1 2024-09-11T01:57:16.065 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:16.065 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:16.065 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:57:16.065 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:16.065 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:16.065 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:16.350 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install rbd-mirror 2024-09-11T01:57:16.541 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:43 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:16.633 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:16.676 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:16.677 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-11T01:57:16.677 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:16.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rados 2024-09-11T01:57:16.926 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:48 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:17.068 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:17.068 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:17.069 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repo Size 2024-09-11T01:57:17.069 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:17.069 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:57:17.069 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T01:57:17.069 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:17.069 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:57:17.069 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:17.069 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-11T01:57:17.069 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:17.070 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 3.2 M 2024-09-11T01:57:17.070 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 14 M 2024-09-11T01:57:17.070 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:57:17.310 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:44 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:17.381 INFO:teuthology.orchestra.run.smithi203.stdout:rbd-mirror-19.3.0-4854.g8f219c47.el9.x86_64.rpm 10 MB/s | 3.2 MB 00:00 2024-09-11T01:57:17.382 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:17.382 INFO:teuthology.orchestra.run.smithi203.stdout:Total 10 MB/s | 3.2 MB 00:00 2024-09-11T01:57:17.383 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:57:17.391 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:57:17.391 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:57:17.399 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:17.443 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:17.445 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-11T01:57:17.445 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:17.475 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:57:17.475 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:57:17.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rgw 2024-09-11T01:57:17.920 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:57:17.982 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:18.006 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:18.006 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:57:18.006 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T01:57:18.007 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T01:57:18.007 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T01:57:18.007 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:18.091 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:45 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:18.181 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:18.225 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:18.226 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-11T01:57:18.226 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:18.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-cephfs 2024-09-11T01:57:18.901 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:45 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:18.991 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:19.034 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:19.035 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-11T01:57:19.035 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:19.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rbd 2024-09-11T01:57:19.158 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:19.158 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:19.158 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:57:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:19.159 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:19.410 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install rbd-nbd 2024-09-11T01:57:19.668 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:46 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:19.758 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 is already installed. 2024-09-11T01:57:19.801 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:19.802 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2024-09-11T01:57:19.802 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:19.871 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-fuse 2024-09-11T01:57:19.984 INFO:teuthology.orchestra.run.smithi203.stdout:Last metadata expiration check: 0:01:51 ago on Wed 11 Sep 2024 01:55:28 AM UTC. 2024-09-11T01:57:20.124 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-11T01:57:20.125 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:20.125 INFO:teuthology.orchestra.run.smithi203.stdout: Package Architecture Version Repository Size 2024-09-11T01:57:20.125 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:20.125 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-11T01:57:20.125 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T01:57:20.126 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:20.126 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-11T01:57:20.126 INFO:teuthology.orchestra.run.smithi203.stdout:================================================================================ 2024-09-11T01:57:20.126 INFO:teuthology.orchestra.run.smithi203.stdout:Install 1 Package 2024-09-11T01:57:20.126 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:20.126 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 171 k 2024-09-11T01:57:20.126 INFO:teuthology.orchestra.run.smithi203.stdout:Installed size: 490 k 2024-09-11T01:57:20.126 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-11T01:57:20.343 INFO:teuthology.orchestra.run.smithi203.stdout:rbd-nbd-19.3.0-4854.g8f219c47.el9.x86_64.rpm 787 kB/s | 171 kB 00:00 2024-09-11T01:57:20.344 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:20.344 INFO:teuthology.orchestra.run.smithi203.stdout:Total 781 kB/s | 171 kB 00:00 2024-09-11T01:57:20.344 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-11T01:57:20.351 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-11T01:57:20.351 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-11T01:57:20.415 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-11T01:57:20.416 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-11T01:57:20.435 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:47 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:20.564 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-11T01:57:20.566 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:20.566 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:20.567 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-11T01:57:20.567 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:20.567 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:57:20.567 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T01:57:20.567 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:20.567 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:57:20.567 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:20.567 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-11T01:57:20.567 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:20.568 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 85 k 2024-09-11T01:57:20.568 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 231 k 2024-09-11T01:57:20.568 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:57:20.665 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:20.765 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-fuse-19.3.0-4854.g8f219c47.el9.x86_64.rpm 432 kB/s | 85 kB 00:00 2024-09-11T01:57:20.766 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:20.766 INFO:teuthology.orchestra.run.smithi073.stdout:Total 429 kB/s | 85 kB 00:00 2024-09-11T01:57:20.766 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:57:20.773 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:57:20.773 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:57:20.837 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:57:20.838 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:57:20.989 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:57:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:21.090 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:21.331 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:21.331 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:21.331 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-11T01:57:21.331 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:21.331 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:21.331 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-11T01:57:21.468 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:21.586 DEBUG:teuthology.parallel:result is None 2024-09-11T01:57:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:21.725 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:57:21.725 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:21.726 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:21.726 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:21.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-mirror 2024-09-11T01:57:22.549 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:49 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:22.687 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:22.688 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2024-09-11T01:57:22.688 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:22.688 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:57:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T01:57:22.688 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:22.688 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:57:22.688 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:22.688 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-11T01:57:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:22.689 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 3.2 M 2024-09-11T01:57:22.689 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 14 M 2024-09-11T01:57:22.689 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:57:23.027 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-mirror-19.3.0-4854.g8f219c47.el9.x86_64.rpm 9.4 MB/s | 3.2 MB 00:00 2024-09-11T01:57:23.028 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:23.028 INFO:teuthology.orchestra.run.smithi073.stdout:Total 9.3 MB/s | 3.2 MB 00:00 2024-09-11T01:57:23.028 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:57:23.037 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:57:23.037 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:57:23.118 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:57:23.119 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:57:23.565 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:57:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:23.753 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:23.754 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T01:57:23.754 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T01:57:23.754 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T01:57:23.754 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T01:57:23.754 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:24.725 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:24.725 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:24.725 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:57:24.725 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:24.725 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:24.725 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:24.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-nbd 2024-09-11T01:57:25.522 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:52 ago on Wed 11 Sep 2024 01:55:33 AM UTC. 2024-09-11T01:57:25.659 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-11T01:57:25.660 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:25.660 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-11T01:57:25.660 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:25.660 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-11T01:57:25.660 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T01:57:25.660 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:25.660 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-11T01:57:25.661 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-11T01:57:25.661 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2024-09-11T01:57:25.661 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:25.661 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 171 k 2024-09-11T01:57:25.661 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 490 k 2024-09-11T01:57:25.661 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-11T01:57:25.881 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-nbd-19.3.0-4854.g8f219c47.el9.x86_64.rpm 776 kB/s | 171 kB 00:00 2024-09-11T01:57:25.882 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-11T01:57:25.882 INFO:teuthology.orchestra.run.smithi073.stdout:Total 770 kB/s | 171 kB 00:00 2024-09-11T01:57:25.882 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-11T01:57:25.890 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-11T01:57:25.890 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-11T01:57:25.955 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-11T01:57:25.955 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-11T01:57:26.137 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-11T01:57:26.237 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:26.655 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 1/1 2024-09-11T01:57:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:26.949 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-11T01:57:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T01:57:26.949 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:26.949 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-11T01:57:27.159 DEBUG:teuthology.parallel:result is None 2024-09-11T01:57:27.159 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T01:57:27.320 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T01:57:27.341 INFO:teuthology.orchestra.run.smithi073.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T01:57:27.342 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T01:57:27.342 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T01:57:27.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T01:57:27.502 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T01:57:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T01:57:27.529 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T01:57:27.529 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T01:57:27.531 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T01:57:27.531 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:27.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T01:57:27.556 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:27.556 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T01:57:27.600 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T01:57:27.601 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:27.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T01:57:27.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T01:57:27.690 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:27.690 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T01:57:27.718 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T01:57:27.787 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T01:57:27.787 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:27.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T01:57:27.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T01:57:27.877 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:27.877 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T01:57:27.905 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T01:57:27.972 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T01:57:27.972 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:27.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T01:57:27.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T01:57:28.062 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:28.062 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T01:57:28.090 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T01:57:28.157 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T01:57:28.252 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T01:57:28.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-09-11T01:57:28.255 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /var/log/ceph 2024-09-11T01:57:28.281 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T01:57:28.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T01:57:28.320 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T01:57:28.348 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T01:57:28.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T01:57:28.385 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T01:57:28.423 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T01:57:28.423 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-09-11T01:57:28.424 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935', 'branch': 'wip-hemanth-testing-2024-09-10-0723', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete}', 'email': 'hyelloji@redhat.com', 'first_in_suite': False, 'job_id': '7899935', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-hemanth-testing-2024-09-10-0723'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'mon_bind_msgr2': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-hemanth-testing-2024-09-10-0723', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}}, 'owner': 'scheduled_hyelloji@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 9167, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-hemanth-testing-2024-09-10-0723', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLZbwLdZu+L+u1UPPH7l/SFFGKXcwnID7RbfnncWYguUu7NsmDmWRiXMJn4m6R74i0Y0O6rttLK6iLhRaysKUlM=', 'smithi203.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL8vTrbjGcr7FnH2Lg7LIkxUE7JfczL1U6HRY5O4AfDf4DhA9PdbPCqwDuRPqDeXXnn8PrcNvZOcD/+epioXYF0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'thrash_delay': 1, 'thrash_many': True}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_17:16:14', 'tube': 'smithi', 'user': 'hyelloji', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T01:57:28.424 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T01:57:28.450 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T01:57:28.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T01:57:28.505 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T01:57:28.535 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:28.535 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T01:57:28.583 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T01:57:28.583 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-11T01:57:28.638 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T01:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T01:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-11T01:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T01:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T01:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-11 01:57:24.008777255 +0000 2024-09-11T01:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-11 01:54:50.833466916 +0000 2024-09-11T01:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-11 01:54:50.833466916 +0000 2024-09-11T01:57:28.639 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-11 01:54:50.833466916 +0000 2024-09-11T01:57:28.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T01:57:28.701 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-11T01:57:28.702 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-11T01:57:28.702 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000202608 s, 2.5 MB/s 2024-09-11T01:57:28.703 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T01:57:28.760 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-11T01:57:28.815 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T01:57:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T01:57:28.816 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T01:57:28.816 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T01:57:28.816 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T01:57:28.816 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-11 01:57:24.008777255 +0000 2024-09-11T01:57:28.816 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-11 01:54:51.179459328 +0000 2024-09-11T01:57:28.816 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-11 01:54:51.179459328 +0000 2024-09-11T01:57:28.816 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-11 01:54:51.179459328 +0000 2024-09-11T01:57:28.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T01:57:28.878 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-11T01:57:28.879 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-11T01:57:28.879 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000221731 s, 2.3 MB/s 2024-09-11T01:57:28.880 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T01:57:28.937 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-11T01:57:28.992 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T01:57:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T01:57:28.993 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-11T01:57:28.993 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T01:57:28.993 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T01:57:28.993 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-11 01:57:24.008777255 +0000 2024-09-11T01:57:28.993 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-11 01:54:51.487452573 +0000 2024-09-11T01:57:28.993 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-11 01:54:51.487452573 +0000 2024-09-11T01:57:28.993 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-11 01:54:51.487452573 +0000 2024-09-11T01:57:28.993 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T01:57:29.055 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-11T01:57:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-11T01:57:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000246857 s, 2.1 MB/s 2024-09-11T01:57:29.057 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T01:57:29.114 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-11T01:57:29.169 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T01:57:29.169 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T01:57:29.169 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T01:57:29.170 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T01:57:29.170 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T01:57:29.170 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-11 01:57:24.009777233 +0000 2024-09-11T01:57:29.170 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-11 01:54:51.799445731 +0000 2024-09-11T01:57:29.170 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-11 01:54:51.799445731 +0000 2024-09-11T01:57:29.170 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-11 01:54:51.799445731 +0000 2024-09-11T01:57:29.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T01:57:29.232 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-11T01:57:29.233 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-11T01:57:29.233 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000249024 s, 2.1 MB/s 2024-09-11T01:57:29.234 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T01:57:29.290 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T01:57:29.290 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:29.291 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T01:57:29.308 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T01:57:29.309 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-09-11T01:57:29.366 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T01:57:29.366 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T01:57:29.366 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T01:57:29.366 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T01:57:29.366 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T01:57:29.366 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-11 01:57:18.258177295 +0000 2024-09-11T01:57:29.366 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-11 01:54:50.827362823 +0000 2024-09-11T01:57:29.366 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-11 01:54:50.827362823 +0000 2024-09-11T01:57:29.366 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-11 01:54:50.827362823 +0000 2024-09-11T01:57:29.367 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T01:57:29.433 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-11T01:57:29.434 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-11T01:57:29.434 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000196255 s, 2.6 MB/s 2024-09-11T01:57:29.434 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T01:57:29.491 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-09-11T01:57:29.548 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T01:57:29.548 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T01:57:29.548 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-11T01:57:29.548 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T01:57:29.548 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T01:57:29.548 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-11 01:57:18.259177269 +0000 2024-09-11T01:57:29.548 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-11 01:54:51.144354628 +0000 2024-09-11T01:57:29.548 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-11 01:54:51.144354628 +0000 2024-09-11T01:57:29.549 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-11 01:54:51.144354628 +0000 2024-09-11T01:57:29.549 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T01:57:29.613 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-11T01:57:29.614 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-11T01:57:29.614 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000230639 s, 2.2 MB/s 2024-09-11T01:57:29.615 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T01:57:29.673 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-09-11T01:57:29.728 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T01:57:29.729 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T01:57:29.729 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-11T01:57:29.729 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T01:57:29.729 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T01:57:29.729 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-11 01:57:18.259177269 +0000 2024-09-11T01:57:29.729 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-11 01:54:51.471346173 +0000 2024-09-11T01:57:29.729 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-11 01:54:51.471346173 +0000 2024-09-11T01:57:29.729 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-11 01:54:51.471346173 +0000 2024-09-11T01:57:29.729 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T01:57:29.792 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-11T01:57:29.793 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-11T01:57:29.793 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000203832 s, 2.5 MB/s 2024-09-11T01:57:29.794 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T01:57:29.851 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-09-11T01:57:29.907 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T01:57:29.908 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T01:57:29.908 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-11T01:57:29.908 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T01:57:29.908 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T01:57:29.908 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-11 01:57:18.259177269 +0000 2024-09-11T01:57:29.908 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-11 01:54:51.796337771 +0000 2024-09-11T01:57:29.908 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-11 01:54:51.796337771 +0000 2024-09-11T01:57:29.908 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-11 01:54:51.796337771 +0000 2024-09-11T01:57:29.908 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T01:57:29.971 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-11T01:57:29.972 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-11T01:57:29.972 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000199958 s, 2.6 MB/s 2024-09-11T01:57:29.973 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T01:57:30.031 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-11T01:57:30.031 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-11T01:57:30.031 INFO:tasks.ceph:Generating config... 2024-09-11T01:57:30.032 INFO:tasks.ceph:[client] debug monc = 20 2024-09-11T01:57:30.032 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T01:57:30.033 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-11T01:57:30.033 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-11T01:57:30.033 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-09-11T01:57:30.033 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-11T01:57:30.033 INFO:tasks.ceph:[global] ms type = async 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-11T01:57:30.033 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2024-09-11T01:57:30.034 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2024-09-11T01:57:30.034 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-11T01:57:30.034 INFO:tasks.ceph:[mon] paxos min = 10 2024-09-11T01:57:30.034 INFO:tasks.ceph:[mon] paxos service trim min = 5 2024-09-11T01:57:30.034 INFO:tasks.ceph:[mon] paxos trim min = 10 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T01:57:30.034 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-11T01:57:30.035 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-11T01:57:30.036 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T01:57:30.036 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:30.088 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T01:57:30.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T01:57:30.133 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T01:57:30.198 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.73:6789]'), ('mon.b', '[v1:172.21.15.73:6790]'), ('mon.c', '[v1:172.21.15.73:6791]'), ('mon.d', '[v1:172.21.15.73:6792]'), ('mon.e', '[v1:172.21.15.73:6793]'), ('mon.f', '[v1:172.21.15.203:6789]'), ('mon.g', '[v1:172.21.15.203:6790]'), ('mon.h', '[v1:172.21.15.203:6791]'), ('mon.i', '[v1:172.21.15.203:6792]')] 2024-09-11T01:57:30.198 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.73:6789],[v1:172.21.15.73:6790],[v1:172.21.15.73:6791],[v1:172.21.15.73:6792],[v1:172.21.15.73:6793],[v1:172.21.15.203:6789],[v1:172.21.15.203:6790],[v1:172.21.15.203:6791],[v1:172.21.15.203:6792]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2024-09-11T01:57:30.199 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:30.199 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T01:57:30.256 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.73:6789]' --addv b '[v1:172.21.15.73:6790]' --addv c '[v1:172.21.15.73:6791]' --addv d '[v1:172.21.15.73:6792]' --addv e '[v1:172.21.15.73:6793]' --addv f '[v1:172.21.15.203:6789]' --addv g '[v1:172.21.15.203:6790]' --addv h '[v1:172.21.15.203:6791]' --addv i '[v1:172.21.15.203:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 17 (quincy) 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 3 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:1: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:2: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:57:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:3: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:57:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:4: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:57:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:5: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:57:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:6: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:57:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:7: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:57:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:8: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:57:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2024-09-11T01:57:30.360 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T01:57:30.375 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4... 2024-09-11T01:57:30.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T01:57:30.417 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-09-11T01:57:30.458 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.459 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.460 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "[v1:172.21.15.73:6789],[v1:172.21.15.73:6790],[v1:172.21.15.73:6791],[v1:172.21.15.73:6792],[v1:172.21.15.73:6793],[v1:172.21.15.203:6789],[v1:172.21.15.203:6790],[v1:172.21.15.203:6791],[v1:172.21.15.203:6792]" 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: mon client directed command retry = 5 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: mon election default strategy = 3 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: ms bind msgr2 = False 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject socket failures = 5000 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: ms type = async 2024-09-11T01:57:30.461 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-09-11T01:57:30.462 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-09-11T01:57:30.463 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression algorithm = zlib 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression mode = aggressive 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore write v2 random = True 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore zero block detection = True 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-09-11T01:57:30.464 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify cached snaps = True 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify missing on start = True 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock override recovery settings = True 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: osd op queue = debug_random 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: osd op queue cut off = debug_random 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-11T01:57:30.465 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-09-11T01:57:30.466 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T01:57:30.467 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: mon min osdmap epochs = 25 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: mon osdmap full prune interval = 2 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: mon osdmap full prune min = 15 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: mon osdmap full prune txsize = 2 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: mon scrub inject crc mismatch = 0.01 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: mon scrub inject missing keys = 0.05 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: mon scrub interval = 300 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: paxos min = 10 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: paxos service trim min = 5 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: paxos trim min = 10 2024-09-11T01:57:30.468 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout: debug monc = 20 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.d] 2024-09-11T01:57:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.e] 2024-09-11T01:57:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.f] 2024-09-11T01:57:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.g] 2024-09-11T01:57:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.h] 2024-09-11T01:57:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.i] 2024-09-11T01:57:30.470 INFO:teuthology.orchestra.run.smithi203.stdout:[global] 2024-09-11T01:57:30.470 INFO:teuthology.orchestra.run.smithi203.stdout: chdir = "" 2024-09-11T01:57:30.470 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: auth supported = cephx 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: filestore xattr use omap = true 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: mon clock drift allowed = 1.000 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: osd crush chooseleaf type = 0 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: auth debug = true 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on old message = true 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on bug = true 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T01:57:30.471 INFO:teuthology.orchestra.run.smithi203.stdout: mon pg warn max object skew = 0 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default size = 2 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow primary affinity = true 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow pg remap = true 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on legacy crush tunables = false 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on crush straw calc version zero = false 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on no sortbitwise = false 2024-09-11T01:57:30.472 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on osd down out interval zero = false 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on too few osds = false 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: mon_allow_pool_size_one = true 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: osd default data pool replay window = 5 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: mon allow pool delete = true 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: mon cluster log file level = debug 2024-09-11T01:57:30.473 INFO:teuthology.orchestra.run.smithi203.stdout: debug asserts on shutdown = true 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: mon health detail to clog = false 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: mon host = "[v1:172.21.15.73:6789],[v1:172.21.15.73:6790],[v1:172.21.15.73:6791],[v1:172.21.15.73:6792],[v1:172.21.15.73:6793],[v1:172.21.15.203:6789],[v1:172.21.15.203:6790],[v1:172.21.15.203:6791],[v1:172.21.15.203:6792]" 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: mon client directed command retry = 5 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: mon election default strategy = 3 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: ms bind msgr2 = False 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: ms inject socket failures = 5000 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: ms type = async 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: fsid = 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout:[osd] 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: osd journal size = 100 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub load threshold = 5.0 2024-09-11T01:57:30.474 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub max interval = 600 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd mclock profile = high_recovery_ops 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd recover clone overlap = true 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd recovery max chunk = 1048576 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug shutdown = true 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug op order = true 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug verify stray on activate = true 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug trim objects = true 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd open classes on start = true 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug pg log writeout = true 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.475 INFO:teuthology.orchestra.run.smithi203.stdout: osd deep scrub update digest min age = 30 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: osd map max advance = 10 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: journal zero on create = true 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: filestore ondisk finisher threads = 3 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: filestore apply finisher threads = 3 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: bdev debug aio = true 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug misdirected ops = true 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore block size = 96636764160 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore compression algorithm = zlib 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore compression mode = aggressive 2024-09-11T01:57:30.476 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore fsck on mount = True 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore write v2 random = True 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore zero block detection = True 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluefs = 20 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluestore = 20 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: debug osd = 20 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: debug rocksdb = 10 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd full ratio = 0.9 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd nearfull ratio = 0.8 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug verify cached snaps = True 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug verify missing on start = True 2024-09-11T01:57:30.477 INFO:teuthology.orchestra.run.smithi203.stdout: osd failsafe full ratio = 0.95 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: osd mclock override recovery settings = True 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: osd objectstore = bluestore 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: osd op queue = debug_random 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: osd op queue cut off = debug_random 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr] 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: debug mgr = 20 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: mgr/telemetry/nag = false 2024-09-11T01:57:30.478 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout:[mon] 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: debug paxos = 20 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: mon data avail warn = 5 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: mon mgr mkfs grace = 240 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd reporter subtree level = osd 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd prime pg temp = true 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T01:57:30.479 INFO:teuthology.orchestra.run.smithi203.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: # 1m isn't quite enough 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: mon_down_mkfs_grace = 2m 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_filestore_osds = false 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: mon min osdmap epochs = 25 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: mon osdmap full prune interval = 2 2024-09-11T01:57:30.480 INFO:teuthology.orchestra.run.smithi203.stdout: mon osdmap full prune min = 15 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: mon osdmap full prune txsize = 2 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: mon scrub inject crc mismatch = 0.01 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: mon scrub inject missing keys = 0.05 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: mon scrub interval = 300 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: paxos min = 10 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: paxos service trim min = 5 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: paxos trim min = 10 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout:[client] 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: rgw cache enabled = true 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable ops log = true 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable usage log = true 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T01:57:30.481 INFO:teuthology.orchestra.run.smithi203.stdout: debug monc = 20 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.a] 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.b] 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.c] 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.d] 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.e] 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.f] 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.g] 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.h] 2024-09-11T01:57:30.482 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.i] 2024-09-11T01:57:30.484 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T01:57:30.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T01:57:30.578 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T01:57:30.578 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:30.578 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T01:57:30.593 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:30.593 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T01:57:30.648 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-09-11T01:57:30.648 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:30.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T01:57:30.649 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T01:57:30.724 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:30.724 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:30.780 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T01:57:30.780 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:30.780 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T01:57:30.780 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T01:57:30.816 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:30.816 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:30.872 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T01:57:30.872 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T01:57:30.872 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T01:57:30.980 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T01:57:30.983 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T01:57:30.983 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T01:57:30.983 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T01:57:31.024 INFO:teuthology.orchestra.run.smithi203.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T01:57:31.036 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T01:57:31.036 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-11T01:57:31.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T01:57:31.061 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T01:57:31.061 INFO:tasks.ceph:role: osd.0 2024-09-11T01:57:31.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-11T01:57:31.062 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T01:57:31.135 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T01:57:31.135 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T01:57:31.135 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T01:57:31.135 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T01:57:31.135 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T01:57:31.135 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-11T01:57:31.135 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T01:57:31.135 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T01:57:31.135 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T01:57:31.136 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T01:57:31.651 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-11T01:57:31.653 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-11T01:57:31.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T01:57:31.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T01:57:31.822 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T01:57:31.888 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T01:57:31.888 INFO:tasks.ceph:role: osd.1 2024-09-11T01:57:31.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-11T01:57:31.888 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T01:57:31.961 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T01:57:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T01:57:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T01:57:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T01:57:31.961 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T01:57:31.961 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-11T01:57:31.961 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T01:57:31.961 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T01:57:31.962 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T01:57:31.962 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T01:57:32.417 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-11T01:57:32.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-11T01:57:32.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T01:57:32.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T01:57:32.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T01:57:32.605 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-11T01:57:32.605 INFO:tasks.ceph:role: osd.2 2024-09-11T01:57:32.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-11T01:57:32.606 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T01:57:32.677 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T01:57:32.678 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T01:57:32.678 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T01:57:32.678 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T01:57:32.678 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T01:57:32.678 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-11T01:57:32.678 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T01:57:32.678 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T01:57:32.678 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T01:57:32.678 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T01:57:33.157 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-11T01:57:33.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-11T01:57:33.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T01:57:33.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T01:57:33.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:33.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:33.439+0000 7f3767eb6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T01:57:33.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:33.446+0000 7f3767eb6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T01:57:33.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:33.446+0000 7f3767eb6640 -1 bdev(0x5567c6e1b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T01:57:33.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:33.446+0000 7f3767eb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T01:57:36.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T01:57:36.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:36.471+0000 7f7d97218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T01:57:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:36.471+0000 7f7d97218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T01:57:36.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:36.472+0000 7f7d97218640 -1 bdev(0x55bbbba2d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T01:57:36.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:36.472+0000 7f7d97218640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T01:57:39.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T01:57:39.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:40.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:40.009+0000 7f48c6015640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T01:57:40.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:40.010+0000 7f48c6015640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T01:57:40.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:40.010+0000 7f48c6015640 -1 bdev(0x56268f3a7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T01:57:40.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:40.010+0000 7f48c6015640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T01:57:42.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T01:57:42.948 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T01:57:42.978 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-11T01:57:42.978 INFO:tasks.ceph:role: osd.3 2024-09-11T01:57:42.979 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T01:57:42.979 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T01:57:43.055 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T01:57:43.055 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T01:57:43.055 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T01:57:43.055 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T01:57:43.055 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T01:57:43.055 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-09-11T01:57:43.056 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T01:57:43.056 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T01:57:43.056 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T01:57:43.056 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T01:57:43.520 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-09-11T01:57:43.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-09-11T01:57:43.522 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-11T01:57:43.646 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T01:57:43.679 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T01:57:43.744 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-11T01:57:43.744 INFO:tasks.ceph:role: osd.4 2024-09-11T01:57:43.744 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T01:57:43.745 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T01:57:43.816 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T01:57:43.816 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T01:57:43.816 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T01:57:43.816 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T01:57:43.816 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T01:57:43.817 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-09-11T01:57:43.817 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T01:57:43.817 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T01:57:43.817 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T01:57:43.817 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T01:57:44.278 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-09-11T01:57:44.280 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-09-11T01:57:44.280 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-11T01:57:44.351 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T01:57:44.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T01:57:44.483 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-11T01:57:44.484 INFO:tasks.ceph:role: osd.5 2024-09-11T01:57:44.484 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T01:57:44.484 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T01:57:44.555 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T01:57:44.555 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T01:57:44.555 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T01:57:44.555 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T01:57:44.555 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T01:57:44.555 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-09-11T01:57:44.555 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T01:57:44.555 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T01:57:44.556 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T01:57:44.556 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T01:57:45.039 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-09-11T01:57:45.041 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-09-11T01:57:45.041 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-11T01:57:45.129 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T01:57:45.159 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:45.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:45.251+0000 7f93a9ae0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T01:57:45.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:45.252+0000 7f93a9ae0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T01:57:45.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:45.252+0000 7f93a9ae0640 -1 bdev(0x559f8ae9d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T01:57:45.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:45.252+0000 7f93a9ae0640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T01:57:48.418 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T01:57:48.447 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:48.538 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:48.536+0000 7fb302c0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T01:57:48.539 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:48.537+0000 7fb302c0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T01:57:48.539 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:48.537+0000 7fb302c0d640 -1 bdev(0x561cb389d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T01:57:48.539 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:48.537+0000 7fb302c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T01:57:51.707 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T01:57:51.736 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:51.827 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:51.825+0000 7f603160c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T01:57:51.827 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:51.825+0000 7f603160c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T01:57:51.827 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:51.825+0000 7f603160c640 -1 bdev(0x55ac82985800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T01:57:51.827 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:57:51.825+0000 7f603160c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T01:57:54.753 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T01:57:54.780 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T01:57:54.780 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:54.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T01:57:54.811 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:54.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T01:57:54.880 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:57:54.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T01:57:54.949 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:54.949 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T01:57:54.976 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:54.976 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T01:57:55.042 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:55.042 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T01:57:55.108 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:55.108 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T01:57:55.172 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:57:55.173 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T01:57:55.228 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T01:57:55.228 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T01:57:55.230 DEBUG:teuthology.orchestra.run.smithi203:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T01:57:55.271 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-09-11T01:57:55.271 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAN+eBmjlJGGhAATD5ETLt8mtnmP8htqD+Xhg== 2024-09-11T01:57:55.271 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-09-11T01:57:55.271 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAQ+eBmFx4pHBAAqTooNBvJniVagagIlCPIfQ== 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAU+eBmYIylABAALulepl9zoTvaGzhHIx4xhg== 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAK+eBmAQpnOhAAh2jnz/aSjmrdt6UPOZzOqw== 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAZ+eBm0iwQDxAAUlgHNnYyk6x7TKSlGD5DKA== 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAc+eBma5UOIBAA7yJKd6MVoEZWYlHDcBbNww== 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAf+eBmToo/MRAAinNAaYPxaQ3LE1xD0CIEJw== 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-11T01:57:55.272 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAL+eBmcKFlARAAiO5bunjm/n8fP+o8ulObbw== 2024-09-11T01:57:55.291 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.0] 2024-09-11T01:57:55.291 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQAN+eBmjlJGGhAATD5ETLt8mtnmP8htqD+Xhg== 2024-09-11T01:57:55.291 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.1] 2024-09-11T01:57:55.291 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQAQ+eBmFx4pHBAAqTooNBvJniVagagIlCPIfQ== 2024-09-11T01:57:55.291 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.2] 2024-09-11T01:57:55.291 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQAU+eBmYIylABAALulepl9zoTvaGzhHIx4xhg== 2024-09-11T01:57:55.291 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr.x] 2024-09-11T01:57:55.292 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQAK+eBmAQpnOhAAh2jnz/aSjmrdt6UPOZzOqw== 2024-09-11T01:57:55.292 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.3] 2024-09-11T01:57:55.292 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQAZ+eBm0iwQDxAAUlgHNnYyk6x7TKSlGD5DKA== 2024-09-11T01:57:55.292 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.4] 2024-09-11T01:57:55.292 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQAc+eBma5UOIBAA7yJKd6MVoEZWYlHDcBbNww== 2024-09-11T01:57:55.292 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.5] 2024-09-11T01:57:55.292 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQAf+eBmToo/MRAAinNAaYPxaQ3LE1xD0CIEJw== 2024-09-11T01:57:55.292 INFO:teuthology.orchestra.run.smithi203.stdout:[client.0] 2024-09-11T01:57:55.292 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQAL+eBmcKFlARAAiO5bunjm/n8fP+o8ulObbw== 2024-09-11T01:57:55.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.316 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.388 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.444 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T01:57:55.499 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T01:57:55.550 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.552 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.605 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.659 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T01:57:55.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T01:57:55.712 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T01:57:55.766 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T01:57:55.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T01:57:55.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:55.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T01:57:55.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T01:57:55.976 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:56.073 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T01:57:56.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T01:57:56.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:56.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T01:57:56.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2024-09-11T01:57:56.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:56.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2024-09-11T01:57:56.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2024-09-11T01:57:56.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:56.631 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2024-09-11T01:57:56.656 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2024-09-11T01:57:56.686 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:56.792 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2024-09-11T01:57:56.818 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2024-09-11T01:57:56.885 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:56.983 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2024-09-11T01:57:57.007 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2024-09-11T01:57:57.072 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:57.169 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2024-09-11T01:57:57.194 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2024-09-11T01:57:57.258 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T01:57:57.356 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2024-09-11T01:57:57.381 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:57.384 DEBUG:teuthology.orchestra.run.smithi203:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T01:57:57.436 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T01:57:57.436 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T01:57:57.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T01:57:57.442 INFO:tasks.ceph.mon.a:Started 2024-09-11T01:57:57.442 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T01:57:57.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T01:57:57.444 INFO:tasks.ceph.mon.b:Started 2024-09-11T01:57:57.444 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T01:57:57.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T01:57:57.447 INFO:tasks.ceph.mon.c:Started 2024-09-11T01:57:57.447 INFO:tasks.ceph.mon.d:Restarting daemon 2024-09-11T01:57:57.447 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-09-11T01:57:57.449 INFO:tasks.ceph.mon.d:Started 2024-09-11T01:57:57.449 INFO:tasks.ceph.mon.e:Restarting daemon 2024-09-11T01:57:57.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-09-11T01:57:57.451 INFO:tasks.ceph.mon.e:Started 2024-09-11T01:57:57.451 INFO:tasks.ceph.mon.f:Restarting daemon 2024-09-11T01:57:57.451 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-09-11T01:57:57.478 INFO:tasks.ceph.mon.f:Started 2024-09-11T01:57:57.479 INFO:tasks.ceph.mon.g:Restarting daemon 2024-09-11T01:57:57.479 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-09-11T01:57:57.481 INFO:tasks.ceph.mon.g:Started 2024-09-11T01:57:57.481 INFO:tasks.ceph.mon.h:Restarting daemon 2024-09-11T01:57:57.481 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-09-11T01:57:57.483 INFO:tasks.ceph.mon.h:Started 2024-09-11T01:57:57.483 INFO:tasks.ceph.mon.i:Restarting daemon 2024-09-11T01:57:57.483 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-09-11T01:57:57.485 INFO:tasks.ceph.mon.i:Started 2024-09-11T01:57:57.485 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T01:57:57.485 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T01:57:57.486 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T01:57:57.487 INFO:tasks.ceph.mgr.x:Started 2024-09-11T01:57:57.488 DEBUG:tasks.ceph:set 0 configs 2024-09-11T01:57:57.488 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T01:57:57.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T01:57:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.618+0000 7fb176ebd640 10 monclient: get_monmap_and_config 2024-09-11T01:57:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.618+0000 7fb176ebd640 10 monclient: build_initial_monmap 2024-09-11T01:57:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.618+0000 7fb176ebd640 10 monclient: monmap: 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:57.619816+0000 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:57.619816+0000 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:57:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:57:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:57:57.622 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:57:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.619+0000 7fb176ebd640 1 Processor -- start 2024-09-11T01:57:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.619+0000 7fb176ebd640 1 -- start start 2024-09-11T01:57:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.619+0000 7fb176ebd640 10 monclient: init 2024-09-11T01:57:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 10 monclient: _reopen_session rank -1 2024-09-11T01:57:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 10 monclient: _add_conns ranks=[4,5,1,0,6,2,3,8,7] 2024-09-11T01:57:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 10 monclient(hunting): picked mon.noname-c con 0x7fb170138960 addr v1:172.21.15.73:6791/0 2024-09-11T01:57:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 10 monclient(hunting): picked mon.noname-h con 0x7fb170139450 addr v1:172.21.15.203:6791/0 2024-09-11T01:57:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 10 monclient(hunting): picked mon.noname-f con 0x7fb17013f620 addr v1:172.21.15.203:6789/0 2024-09-11T01:57:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17009d030 con 0x7fb17013f620 2024-09-11T01:57:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb174c59640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fb170138960 0x7fb170138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:57466/0 (socket says 172.21.15.73:57466) 2024-09-11T01:57:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb174c59640 1 -- 172.21.15.73:0/1707306758 learned_addr learned my addr 172.21.15.73:0/1707306758 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:57:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17009d310 con 0x7fb170138960 2024-09-11T01:57:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb17006f770 con 0x7fb170139450 2024-09-11T01:57:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 10 monclient(hunting): _renew_subs 2024-09-11T01:57:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:57:57.620+0000 7fb176ebd640 10 monclient(hunting): authenticate will time out at 719.224606s 2024-09-11T01:58:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 10 monclient(hunting): tick 2024-09-11T01:58:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 10 monclient(hunting): _check_auth_tickets 2024-09-11T01:58:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 1 monclient(hunting): continuing hunt 2024-09-11T01:58:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 10 monclient(hunting): _reopen_session rank -1 2024-09-11T01:58:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.203:6791/0 conn(0x7fb170139450 legacy=0x7fb17013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.73:6791/0 conn(0x7fb170138960 legacy=0x7fb170138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.203:6789/0 conn(0x7fb17013f620 legacy=0x7fb170141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 10 monclient: _add_conns ranks=[2,3,0,8,6,7] 2024-09-11T01:58:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 10 monclient(hunting): picked mon.noname-b con 0x7fb1540037e0 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 10 monclient(hunting): picked mon.noname-g con 0x7fb154007470 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 10 monclient(hunting): picked mon.noname-a con 0x7fb15400b200 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1700a7360 con 0x7fb15400b200 2024-09-11T01:58:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb154010020 con 0x7fb1540037e0 2024-09-11T01:58:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1540112a0 con 0x7fb154007470 2024-09-11T01:58:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:00.620+0000 7fb16e7fc640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 10 monclient(hunting): tick 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 10 monclient(hunting): _check_auth_tickets 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 1 monclient(hunting): continuing hunt 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 10 monclient(hunting): _reopen_session rank -1 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.203:6790/0 conn(0x7fb154007470 legacy=0x7fb154009930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.73:6790/0 conn(0x7fb1540037e0 legacy=0x7fb154005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.73:6789/0 conn(0x7fb15400b200 legacy=0x7fb15400d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 10 monclient: _add_conns ranks=[8,6,7] 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb17545a640 1 -- 172.21.15.73:0/1707306758 reap_dead start 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 10 monclient(hunting): picked mon.noname-e con 0x7fb15400f1f0 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 10 monclient(hunting): picked mon.noname-d con 0x7fb1540101f0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:03.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 10 monclient(hunting): picked mon.noname-i con 0x7fb154017880 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:03.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb154012520 con 0x7fb1540101f0 2024-09-11T01:58:03.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15401c3a0 con 0x7fb154017880 2024-09-11T01:58:03.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb154006400 con 0x7fb15400f1f0 2024-09-11T01:58:03.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb16e7fc640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:03.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:03.620+0000 7fb17545a640 1 -- 172.21.15.73:0/1707306758 reap_dead start 2024-09-11T01:58:06.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 10 monclient(hunting): tick 2024-09-11T01:58:06.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 10 monclient(hunting): _check_auth_tickets 2024-09-11T01:58:06.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 1 monclient(hunting): continuing hunt 2024-09-11T01:58:06.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 10 monclient(hunting): _reopen_session rank -1 2024-09-11T01:58:06.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.73:6793/0 conn(0x7fb15400f1f0 legacy=0x7fb15400f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.203:6792/0 conn(0x7fb154017880 legacy=0x7fb154019c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.73:6792/0 conn(0x7fb1540101f0 legacy=0x7fb154010620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 10 monclient: _add_conns ranks=[7,5,0,3,6,4,1,2,8] 2024-09-11T01:58:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 10 monclient(hunting): picked mon.noname-i con 0x7fb1540068f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 10 monclient(hunting): picked mon.noname-h con 0x7fb154006d70 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:06.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 10 monclient(hunting): picked mon.noname-a con 0x7fb154007920 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:06.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1540065d0 con 0x7fb154007920 2024-09-11T01:58:06.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb154009dc0 con 0x7fb154006d70 2024-09-11T01:58:06.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15401b3a0 con 0x7fb1540068f0 2024-09-11T01:58:06.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:06.620+0000 7fb16e7fc640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:08.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.629+0000 7fb16f7fe640 1 -- 172.21.15.73:0/1707306758 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1448363544 0 0) 0x7fb1540065d0 con 0x7fb154007920 2024-09-11T01:58:08.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.629+0000 7fb16f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:08.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.629+0000 7fb16f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:08.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.629+0000 7fb16f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:08.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.629+0000 7fb16f7fe640 10 monclient(hunting): my global_id is 4104 2024-09-11T01:58:08.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.629+0000 7fb16f7fe640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb160003520 con 0x7fb154007920 2024-09-11T01:58:08.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 1 -- 172.21.15.73:0/1707306758 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2865268482 0 0) 0x7fb160003520 con 0x7fb154007920 2024-09-11T01:58:08.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.203:6792/0 conn(0x7fb1540068f0 legacy=0x7fb154005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.203:6791/0 conn(0x7fb154006d70 legacy=0x7fb15400d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 1 monclient: found mon.noname-a 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 1 -- 172.21.15.73:0/1707306758 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15401b570 con 0x7fb154007920 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:08.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 1 -- 172.21.15.73:0/1707306758 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb168001ae0 con 0x7fb154007920 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: dump: 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:08.635 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:08.636 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:08.636 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:08.636 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:08.636 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:08.636 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:08.636 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:08.636 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:08.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb176ebd640 5 monclient: authenticate success, global_id 4104 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb176ebd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 1 -- 172.21.15.73:0/1707306758 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb168001cf0 con 0x7fb154007920 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 1 -- 172.21.15.73:0/1707306758 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb168003990 con 0x7fb154007920 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb176ebd640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb176ebd640 4 set_mon_vals no callback set 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.630+0000 7fb16f7fe640 10 monclient: dump: 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.631+0000 7fb176ebd640 10 monclient: shutdown 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.631+0000 7fb176ebd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.631+0000 7fb176ebd640 1 -- 172.21.15.73:0/1707306758 >> v1:172.21.15.73:6789/0 conn(0x7fb154007920 legacy=0x7fb154017c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.631+0000 7fb17545a640 1 -- 172.21.15.73:0/1707306758 reap_dead start 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.631+0000 7fb176ebd640 1 -- 172.21.15.73:0/1707306758 shutdown_connections 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.632+0000 7fb176ebd640 1 -- 172.21.15.73:0/1707306758 >> 172.21.15.73:0/1707306758 conn(0x7fb1700a8050 msgr2=0x7fb1700a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.632+0000 7fb176ebd640 1 -- 172.21.15.73:0/1707306758 shutdown_connections 2024-09-11T01:58:08.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.632+0000 7fb176ebd640 1 -- 172.21.15.73:0/1707306758 wait complete. 2024-09-11T01:58:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.632+0000 7fb176ebd640 10 monclient: build_initial_monmap 2024-09-11T01:58:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.632+0000 7fb176ebd640 10 monclient: monmap: 2024-09-11T01:58:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.633+0000 7fb176ebd640 1 Processor -- start 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.633+0000 7fb176ebd640 1 -- start start 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.633+0000 7fb176ebd640 10 monclient: init 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 10 monclient: _add_conns ranks=[2,0,3,1,6,4,8,5,7] 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 10 monclient(hunting): picked mon.noname-b con 0x7fb154007920 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 10 monclient(hunting): picked mon.noname-a con 0x7fb1701cdeb0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 10 monclient(hunting): picked mon.noname-g con 0x7fb1701ce290 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1701229c0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb174c59640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb154007920 0x7fb1701cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:36550/0 (socket says 172.21.15.73:36550) 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb174c59640 1 -- 172.21.15.73:0/3040934814 learned_addr learned my addr 172.21.15.73:0/3040934814 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb170122ca0 con 0x7fb154007920 2024-09-11T01:58:08.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb170121a20 con 0x7fb1701ce290 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb176ebd640 10 monclient(hunting): authenticate will time out at 730.238560s 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647245811 0 0) 0x7fb1701229c0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb16d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb16d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb16d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.634+0000 7fb16d7fa640 10 monclient(hunting): my global_id is 4113 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb15400fe00 con 0x7fb1701cdeb0 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 494063061 0 0) 0x7fb15400fe00 con 0x7fb1701cdeb0 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1701229c0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb15c0019c0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:08.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:08.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:08.648 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:08.648 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:08.648 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:08.648 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:08.648 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:08.648 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:08.648 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1783769217 0 0) 0x7fb1701229c0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 >> v1:172.21.15.203:6790/0 conn(0x7fb1701ce290 legacy=0x7fb1701d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:08.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 >> v1:172.21.15.73:6790/0 conn(0x7fb154007920 legacy=0x7fb1701cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 monclient: found mon.a 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1701233a0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb176ebd640 5 monclient: authenticate success, global_id 4113 2024-09-11T01:58:08.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb176ebd640 10 monclient: _renew_subs 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb176ebd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb1701d7830 con 0x7fb1701cdeb0 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb176ebd640 10 monclient: _renew_subs 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb176ebd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb1701d7be0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb15c001ca0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb15c003be0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 10 monclient: dump: 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:08.651 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:08.652 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16effd640 4 set_mon_vals no callback set 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7fb15c004190 con 0x7fb1701cdeb0 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.635+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 74840857 0 0) 0x7fb15c005730 con 0x7fb1701cdeb0 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.636+0000 7fb176ebd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.636+0000 7fb176ebd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.636+0000 7fb176ebd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.636+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17006eaf0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.638+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (unknown 1092875540 0 2798735707) 0x7fb15c005930 con 0x7fb1701cdeb0 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.638+0000 7fb16d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:08.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.638+0000 7fb16d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:08.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.713+0000 7fb176ebd640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-09-11T01:58:08.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.713+0000 7fb176ebd640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-09-11T01:58:08.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.713+0000 7fb176ebd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:08.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.713+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb17006eaf0 con 0x7fb1701cdeb0 2024-09-11T01:58:08.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.714+0000 7fb16d7fa640 1 -- 172.21.15.73:0/3040934814 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7fb15c004840 con 0x7fb1701cdeb0 2024-09-11T01:58:08.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.714+0000 7fb16d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-09-11T01:58:08.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.714+0000 7fb16d7fa640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-09-11T01:58:08.716 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-09-11T01:58:08.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.715+0000 7fb176ebd640 10 monclient: shutdown 2024-09-11T01:58:08.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.715+0000 7fb176ebd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:08.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.715+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 >> v1:172.21.15.73:6789/0 conn(0x7fb1701cdeb0 legacy=0x7fb1701d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:08.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.716+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 shutdown_connections 2024-09-11T01:58:08.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.716+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 >> 172.21.15.73:0/3040934814 conn(0x7fb1700a8050 msgr2=0x7fb1700a9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:08.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.716+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 shutdown_connections 2024-09-11T01:58:08.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:08.716+0000 7fb176ebd640 1 -- 172.21.15.73:0/3040934814 wait complete. 2024-09-11T01:58:08.728 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T01:58:08.728 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T01:58:08.728 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:58:08.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T01:58:08.753 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:58:08.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T01:58:08.818 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-11T01:58:08.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T01:58:08.883 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:58:08.883 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T01:58:08.908 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:58:08.908 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T01:58:08.973 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-11T01:58:08.973 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T01:58:09.038 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 0ed1d0ce-ed57-4eed-b684-5c04e84a8405 0 2024-09-11T01:58:09.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.175+0000 7f811171f640 10 monclient: get_monmap_and_config 2024-09-11T01:58:09.178 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.175+0000 7f811171f640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.178 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.175+0000 7f811171f640 10 monclient: monmap: 2024-09-11T01:58:09.178 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.178 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.178 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:58:09.176996+0000 2024-09-11T01:58:09.178 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:58:09.176996+0000 2024-09-11T01:58:09.178 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.179 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.179 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.179 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.179 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.179 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.179 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.179 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.180 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.180 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.180 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.180 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.175+0000 7f811171f640 1 Processor -- start 2024-09-11T01:58:09.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.175+0000 7f811171f640 1 -- start start 2024-09-11T01:58:09.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.175+0000 7f811171f640 10 monclient: init 2024-09-11T01:58:09.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.196 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 10 monclient: _add_conns ranks=[4,3,7,5,8,2,6,0,1] 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 10 monclient(hunting): picked mon.noname-c con 0x7f810c138960 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 10 monclient(hunting): picked mon.noname-g con 0x7f810c139450 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 10 monclient(hunting): picked mon.noname-i con 0x7f810c13f620 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810c09d030 con 0x7f810c139450 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810c09d310 con 0x7f810c138960 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810c06f770 con 0x7f810c13f620 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 10 monclient(hunting): authenticate will time out at 732.621209s 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f810a7fc640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7f810c139450 0x7f810c13df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.203:52212/0 (socket says 172.21.15.203:52212) 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f810a7fc640 1 -- 172.21.15.203:0/1670279248 learned_addr learned my addr 172.21.15.203:0/1670279248 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214666657 0 0) 0x7f810c09d030 con 0x7f810c139450 2024-09-11T01:58:09.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): my global_id is 4116 2024-09-11T01:58:09.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80f4003520 con 0x7f810c139450 2024-09-11T01:58:09.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345610777 0 0) 0x7f810c06f770 con 0x7f810c13f620 2024-09-11T01:58:09.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.198 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): my global_id is 4120 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f810c09d030 con 0x7f810c13f620 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094643046 0 0) 0x7f810c09d310 con 0x7f810c138960 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient(hunting): my global_id is 4108 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f810c06f770 con 0x7f810c138960 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 996792504 0 0) 0x7f80f4003520 con 0x7f810c139450 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 >> v1:172.21.15.203:6792/0 conn(0x7f810c13f620 legacy=0x7f810c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 >> v1:172.21.15.73:6791/0 conn(0x7f810c138960 legacy=0x7f810c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.199 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 monclient: found mon.noname-g 2024-09-11T01:58:09.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 --> v1:172.21.15.203:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c0a7360 con 0x7f810c139450 2024-09-11T01:58:09.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8100001760 con 0x7f810c139450 2024-09-11T01:58:09.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 10 monclient: dump: 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.201 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.203 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.203 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.204 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.204 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.204 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.204 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.204 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 5 monclient: authenticate success, global_id 4116 2024-09-11T01:58:09.204 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f811171f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:09.204 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.176+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 <== mon.3 v1:172.21.15.203:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8100001900 con 0x7f810c139450 2024-09-11T01:58:09.204 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f8109ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.204 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f8109ffb640 1 -- 172.21.15.203:0/1670279248 <== mon.3 v1:172.21.15.203:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8100004be0 con 0x7f810c139450 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f8109ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f8109ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f8109ffb640 10 monclient: dump: 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.205 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f811171f640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f811171f640 4 set_mon_vals no callback set 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f811171f640 10 monclient: shutdown 2024-09-11T01:58:09.206 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f811171f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:09.207 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f811171f640 1 -- 172.21.15.203:0/1670279248 >> v1:172.21.15.203:6790/0 conn(0x7f810c139450 legacy=0x7f810c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.207 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f811171f640 1 -- 172.21.15.203:0/1670279248 shutdown_connections 2024-09-11T01:58:09.207 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f811171f640 1 -- 172.21.15.203:0/1670279248 >> 172.21.15.203:0/1670279248 conn(0x7f810c0a8050 msgr2=0x7f810c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:09.207 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f811171f640 1 -- 172.21.15.203:0/1670279248 shutdown_connections 2024-09-11T01:58:09.207 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.177+0000 7f811171f640 1 -- 172.21.15.203:0/1670279248 wait complete. 2024-09-11T01:58:09.207 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.178+0000 7f811171f640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.207 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.178+0000 7f811171f640 10 monclient: monmap: 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 0.000000 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:created 0.000000 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 1 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.208 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.179+0000 7f811171f640 1 Processor -- start 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.179+0000 7f811171f640 1 -- start start 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.179+0000 7f811171f640 10 monclient: init 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 10 monclient: _add_conns ranks=[0,4,3,8,2,1,6,7,5] 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 10 monclient(hunting): picked mon.noname-a con 0x7f810c138960 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 10 monclient(hunting): picked mon.noname-c con 0x7f810c139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 10 monclient(hunting): picked mon.noname-g con 0x7f810c13f620 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810c138700 con 0x7f810c138960 2024-09-11T01:58:09.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810c13d470 con 0x7f810c13f620 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810c13c760 con 0x7f810c139450 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f811171f640 10 monclient(hunting): authenticate will time out at 732.625267s 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f810b7fe640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7f810c13f620 0x7f810c1d5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.203:52228/0 (socket says 172.21.15.203:52228) 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f810b7fe640 1 -- 172.21.15.203:0/4013497348 learned_addr learned my addr 172.21.15.203:0/4013497348 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 664552222 0 0) 0x7f810c13d470 con 0x7f810c13f620 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): my global_id is 4125 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80f8003520 con 0x7f810c13f620 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810664674 0 0) 0x7f810c13c760 con 0x7f810c139450 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.210 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): my global_id is 4117 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f810c13d470 con 0x7f810c139450 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384169549 0 0) 0x7f810c138700 con 0x7f810c138960 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): my global_id is 4122 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f810c13c760 con 0x7f810c138960 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3613896163 0 0) 0x7f80f8003520 con 0x7f810c13f620 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f810c138700 con 0x7f810c13f620 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8104001df0 con 0x7f810c13f620 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.211 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): dump: 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.212 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4289093039 0 0) 0x7f810c13c760 con 0x7f810c138960 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80f8003520 con 0x7f810c138960 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f80fc0019d0 con 0x7f810c138960 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 10 monclient(hunting): dump: 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.213 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 430522750 0 0) 0x7f810c13d470 con 0x7f810c139450 2024-09-11T01:58:09.214 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.180+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f810c13c760 con 0x7f810c139450 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1281227823 0 0) 0x7f810c138700 con 0x7f810c13f620 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 >> v1:172.21.15.73:6791/0 conn(0x7f810c139450 legacy=0x7f810c137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 >> v1:172.21.15.73:6789/0 conn(0x7f810c138960 legacy=0x7f810c1378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 1 monclient: found mon.g 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.203:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c13c1a0 con 0x7f810c13f620 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 5 monclient: authenticate success, global_id 4125 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 10 monclient: _renew_subs 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.215 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.203:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f810c13c480 con 0x7f810c13f620 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 10 monclient: _renew_subs 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.203:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f810c0a1510 con 0x7f810c13f620 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8104003c20 con 0x7f810c13f620 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8104004150 con 0x7f810c13f620 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f81097fa640 4 set_mon_vals no callback set 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 10 monclient: dump: 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.216 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.217 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f8104005b00 con 0x7f810c13f620 2024-09-11T01:58:09.218 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 8 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (unknown 1708244111 0 0) 0x7f8104006d50 con 0x7f810c13f620 2024-09-11T01:58:09.219 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.219 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.219 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.219 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.181+0000 7f811171f640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.203:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80ec005080 con 0x7f810c13f620 2024-09-11T01:58:09.219 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.183+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (unknown 1092875540 0 2798735707) 0x7f8104004740 con 0x7f810c13f620 2024-09-11T01:58:09.219 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.184+0000 7f80f37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.219 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.184+0000 7f80f37fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:09.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.254+0000 7f811171f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0ed1d0ce-ed57-4eed-b684-5c04e84a8405", "id": 0}] 2024-09-11T01:58:09.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.254+0000 7f811171f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0ed1d0ce-ed57-4eed-b684-5c04e84a8405", "id": 0}] 2024-09-11T01:58:09.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.254+0000 7f811171f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.257 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.254+0000 7f811171f640 1 -- 172.21.15.203:0/4013497348 --> v1:172.21.15.203:6790/0 -- mon_command({"prefix": "osd new", "uuid": "0ed1d0ce-ed57-4eed-b684-5c04e84a8405", "id": 0} v 0) -- 0x7f80ec005370 con 0x7f810c13f620 2024-09-11T01:58:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.257+0000 7f80f37fe640 1 -- 172.21.15.203:0/4013497348 <== mon.3 v1:172.21.15.203:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0ed1d0ce-ed57-4eed-b684-5c04e84a8405", "id": 0}]=0 v3) ==== 112+0+2 (unknown 101753705 0 732707515) 0x7f8104006310 con 0x7f810c13f620 2024-09-11T01:58:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.257+0000 7f80f37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0ed1d0ce-ed57-4eed-b684-5c04e84a8405", "id": 0}] 2024-09-11T01:58:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.257+0000 7f80f37fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:09.260 INFO:teuthology.orchestra.run.smithi203.stdout:0 2024-09-11T01:58:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.258+0000 7f811171f640 10 monclient: shutdown 2024-09-11T01:58:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.258+0000 7f811171f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.258+0000 7f811171f640 1 -- 172.21.15.203:0/4013497348 >> v1:172.21.15.203:6790/0 conn(0x7f810c13f620 legacy=0x7f810c1d5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.258+0000 7f811171f640 1 -- 172.21.15.203:0/4013497348 shutdown_connections 2024-09-11T01:58:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.258+0000 7f811171f640 1 -- 172.21.15.203:0/4013497348 >> 172.21.15.203:0/4013497348 conn(0x7f810c0a8050 msgr2=0x7f810c0a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.258+0000 7f811171f640 1 -- 172.21.15.203:0/4013497348 shutdown_connections 2024-09-11T01:58:09.262 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.258+0000 7f811171f640 1 -- 172.21.15.203:0/4013497348 wait complete. 2024-09-11T01:58:09.271 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 3aa077b3-74c6-4609-8587-8a3c5ec8bc4b 1 2024-09-11T01:58:09.370 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.367+0000 7fa3f6241640 10 monclient: get_monmap_and_config 2024-09-11T01:58:09.370 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.367+0000 7fa3f6241640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.371 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.367+0000 7fa3f6241640 10 monclient: monmap: 2024-09-11T01:58:09.371 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.371 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.371 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:58:09.369215+0000 2024-09-11T01:58:09.371 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:58:09.369215+0000 2024-09-11T01:58:09.371 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.372 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.372 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.372 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.372 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.372 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.372 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.372 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.373 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.373 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.373 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.373 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.373 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 1 Processor -- start 2024-09-11T01:58:09.373 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 1 -- start start 2024-09-11T01:58:09.373 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 10 monclient: init 2024-09-11T01:58:09.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 10 monclient: _add_conns ranks=[8,4,1,7,2,6,0,5,3] 2024-09-11T01:58:09.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 10 monclient(hunting): picked mon.noname-e con 0x7fa3f0138960 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:09.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 10 monclient(hunting): picked mon.noname-c con 0x7fa3f0139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:09.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 10 monclient(hunting): picked mon.noname-f con 0x7fa3f013f620 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:09.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f009d030 con 0x7fa3f013f620 2024-09-11T01:58:09.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f009d310 con 0x7fa3f0139450 2024-09-11T01:58:09.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f006f770 con 0x7fa3f0138960 2024-09-11T01:58:09.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3f6241640 10 monclient(hunting): authenticate will time out at 732.813579s 2024-09-11T01:58:09.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3effff640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fa3f013f620 0x7fa3f0141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:54366/0 (socket says 172.21.15.203:54366) 2024-09-11T01:58:09.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3effff640 1 -- 172.21.15.203:0/3750760273 learned_addr learned my addr 172.21.15.203:0/3750760273 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 110802783 0 0) 0x7fa3f009d030 con 0x7fa3f013f620 2024-09-11T01:58:09.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3ee7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3ee7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.368+0000 7fa3ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient(hunting): my global_id is 4114 2024-09-11T01:58:09.385 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3d8003520 con 0x7fa3f013f620 2024-09-11T01:58:09.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3713814889 0 0) 0x7fa3f009d310 con 0x7fa3f0139450 2024-09-11T01:58:09.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient(hunting): my global_id is 4126 2024-09-11T01:58:09.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f009d030 con 0x7fa3f0139450 2024-09-11T01:58:09.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262488648 0 0) 0x7fa3f006f770 con 0x7fa3f0138960 2024-09-11T01:58:09.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient(hunting): my global_id is 4121 2024-09-11T01:58:09.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f009d310 con 0x7fa3f0138960 2024-09-11T01:58:09.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 938917625 0 0) 0x7fa3d8003520 con 0x7fa3f013f620 2024-09-11T01:58:09.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 >> v1:172.21.15.73:6793/0 conn(0x7fa3f0138960 legacy=0x7fa3f0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 >> v1:172.21.15.73:6791/0 conn(0x7fa3f0139450 legacy=0x7fa3f013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 monclient: found mon.noname-f 2024-09-11T01:58:09.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.203:6789/0 2024-09-11T01:58:09.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f00a7360 con 0x7fa3f013f620 2024-09-11T01:58:09.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3f6241640 5 monclient: authenticate success, global_id 4114 2024-09-11T01:58:09.390 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3e8001bb0 con 0x7fa3f013f620 2024-09-11T01:58:09.390 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.390 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T01:58:09.390 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: dump: 2024-09-11T01:58:09.390 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.390 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.391 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.391 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.391 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.391 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.391 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.391 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.392 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.392 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.392 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.392 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.392 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.392 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.393 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.393 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.393 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3f6241640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:09.393 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 <== mon.1 v1:172.21.15.203:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3e8001dd0 con 0x7fa3f013f620 2024-09-11T01:58:09.393 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.393 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3f6241640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:09.394 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 1 -- 172.21.15.203:0/3750760273 <== mon.1 v1:172.21.15.203:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3e80020c0 con 0x7fa3f013f620 2024-09-11T01:58:09.394 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.394 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3f6241640 4 set_mon_vals no callback set 2024-09-11T01:58:09.394 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:09.394 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3ee7fc640 10 monclient: dump: 2024-09-11T01:58:09.394 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.395 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.395 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.395 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.395 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.395 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.395 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.396 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.396 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.396 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.396 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.396 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.396 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.396 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.397 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.397 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.397 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3f6241640 10 monclient: shutdown 2024-09-11T01:58:09.397 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3f6241640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:09.397 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.369+0000 7fa3f6241640 1 -- 172.21.15.203:0/3750760273 >> v1:172.21.15.203:6789/0 conn(0x7fa3f013f620 legacy=0x7fa3f0141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.397 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.370+0000 7fa3f6241640 1 -- 172.21.15.203:0/3750760273 shutdown_connections 2024-09-11T01:58:09.397 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.370+0000 7fa3f6241640 1 -- 172.21.15.203:0/3750760273 >> 172.21.15.203:0/3750760273 conn(0x7fa3f00a8050 msgr2=0x7fa3f00a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:09.398 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.370+0000 7fa3f6241640 1 -- 172.21.15.203:0/3750760273 shutdown_connections 2024-09-11T01:58:09.398 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.370+0000 7fa3f6241640 1 -- 172.21.15.203:0/3750760273 wait complete. 2024-09-11T01:58:09.398 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.370+0000 7fa3f6241640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.398 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.370+0000 7fa3f6241640 10 monclient: monmap: 2024-09-11T01:58:09.398 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.398 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:09.398 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 0.000000 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:created 0.000000 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 1 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.399 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.370+0000 7fa3f6241640 1 Processor -- start 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 1 -- start start 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 10 monclient: init 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 10 monclient: _add_conns ranks=[5,7,2,6,8,0,1,4,3] 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 10 monclient(hunting): picked mon.noname-h con 0x7fa3f0138960 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 10 monclient(hunting): picked mon.noname-i con 0x7fa3f0139450 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 10 monclient(hunting): picked mon.noname-b con 0x7fa3f013f620 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f013caf0 con 0x7fa3f013f620 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f013aaf0 con 0x7fa3f0138960 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f00a8550 con 0x7fa3f0139450 2024-09-11T01:58:09.400 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3f6241640 10 monclient(hunting): authenticate will time out at 732.816580s 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3ef7fe640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7fa3f0138960 0x7fa3f0139cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.203:60070/0 (socket says 172.21.15.203:60070) 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3ef7fe640 1 -- 172.21.15.203:0/2388330339 learned_addr learned my addr 172.21.15.203:0/2388330339 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251776565 0 0) 0x7fa3f00a8550 con 0x7fa3f0139450 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): my global_id is 4129 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3dc003520 con 0x7fa3f0139450 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291116783 0 0) 0x7fa3f013aaf0 con 0x7fa3f0138960 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.401 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): my global_id is 4109 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f00a8550 con 0x7fa3f0138960 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3357394154 0 0) 0x7fa3f013caf0 con 0x7fa3f013f620 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 10 monclient(hunting): my global_id is 4115 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.371+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f013aaf0 con 0x7fa3f013f620 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1114690078 0 0) 0x7fa3f00a8550 con 0x7fa3f0138960 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3f013caf0 con 0x7fa3f0138960 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 324475413 0 0) 0x7fa3f013aaf0 con 0x7fa3f013f620 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3f00a8550 con 0x7fa3f013f620 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3e0001b10 con 0x7fa3f0138960 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.402 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): dump: 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.403 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2984630013 0 0) 0x7fa3dc003520 con 0x7fa3f0139450 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3f013aaf0 con 0x7fa3f0139450 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3e80013a0 con 0x7fa3f013f620 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): dump: 2024-09-11T01:58:09.404 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.405 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3e40018f0 con 0x7fa3f0139450 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient(hunting): dump: 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.406 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1794304949 0 0) 0x7fa3f00a8550 con 0x7fa3f013f620 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 >> v1:172.21.15.203:6792/0 conn(0x7fa3f0139450 legacy=0x7fa3f013a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 >> v1:172.21.15.203:6791/0 conn(0x7fa3f0138960 legacy=0x7fa3f0139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 monclient: found mon.b 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f00a5130 con 0x7fa3f013f620 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3f6241640 5 monclient: authenticate success, global_id 4115 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3f6241640 10 monclient: _renew_subs 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3f6241640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3f6241640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f013c250 con 0x7fa3f013f620 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3f6241640 10 monclient: _renew_subs 2024-09-11T01:58:09.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3f6241640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3f6241640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3f00a48f0 con 0x7fa3f013f620 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3e8001b90 con 0x7fa3f013f620 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3e80051e0 con 0x7fa3f013f620 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3edffb640 4 set_mon_vals no callback set 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 10 monclient: dump: 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.409 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7fa3e8005790 con 0x7fa3f013f620 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.372+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (unknown 2260363129 0 0) 0x7fa3e8006ae0 con 0x7fa3f013f620 2024-09-11T01:58:09.410 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.373+0000 7fa3f6241640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.373+0000 7fa3f6241640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.373+0000 7fa3f6241640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:09.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.373+0000 7fa3f6241640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d0005080 con 0x7fa3f013f620 2024-09-11T01:58:09.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.375+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (unknown 1092875540 0 2798735707) 0x7fa3e8005ab0 con 0x7fa3f013f620 2024-09-11T01:58:09.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.375+0000 7fa3d7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.375+0000 7fa3d7fff640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:09.448 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.445+0000 7fa3f6241640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3aa077b3-74c6-4609-8587-8a3c5ec8bc4b", "id": 1}] 2024-09-11T01:58:09.448 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.445+0000 7fa3f6241640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3aa077b3-74c6-4609-8587-8a3c5ec8bc4b", "id": 1}] 2024-09-11T01:58:09.448 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.445+0000 7fa3f6241640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:09.448 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.445+0000 7fa3f6241640 1 -- 172.21.15.203:0/2388330339 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd new", "uuid": "3aa077b3-74c6-4609-8587-8a3c5ec8bc4b", "id": 1} v 0) -- 0x7fa3d0005370 con 0x7fa3f013f620 2024-09-11T01:58:09.451 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.448+0000 7fa3d7fff640 1 -- 172.21.15.203:0/2388330339 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3aa077b3-74c6-4609-8587-8a3c5ec8bc4b", "id": 1}]=0 v4) ==== 112+0+2 (unknown 267709844 0 940483276) 0x7fa3e8005e40 con 0x7fa3f013f620 2024-09-11T01:58:09.451 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.448+0000 7fa3d7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3aa077b3-74c6-4609-8587-8a3c5ec8bc4b", "id": 1}] 2024-09-11T01:58:09.451 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.448+0000 7fa3d7fff640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:09.451 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-09-11T01:58:09.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.449+0000 7fa3f6241640 10 monclient: shutdown 2024-09-11T01:58:09.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.449+0000 7fa3f6241640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:09.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.449+0000 7fa3f6241640 1 -- 172.21.15.203:0/2388330339 >> v1:172.21.15.73:6790/0 conn(0x7fa3f013f620 legacy=0x7fa3f01d5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.449+0000 7fa3f6241640 1 -- 172.21.15.203:0/2388330339 shutdown_connections 2024-09-11T01:58:09.452 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.449+0000 7fa3f6241640 1 -- 172.21.15.203:0/2388330339 >> 172.21.15.203:0/2388330339 conn(0x7fa3f00a8050 msgr2=0x7fa3f00a9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:09.453 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.449+0000 7fa3f6241640 1 -- 172.21.15.203:0/2388330339 shutdown_connections 2024-09-11T01:58:09.453 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.449+0000 7fa3f6241640 1 -- 172.21.15.203:0/2388330339 wait complete. 2024-09-11T01:58:09.462 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 063c664b-ce58-42bd-bd80-0d6b9721fcb4 2 2024-09-11T01:58:09.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.557+0000 7f18429da640 10 monclient: get_monmap_and_config 2024-09-11T01:58:09.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.557+0000 7f18429da640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.560 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.557+0000 7f18429da640 10 monclient: monmap: 2024-09-11T01:58:09.560 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:58:09.559761+0000 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:58:09.559761+0000 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.561 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.562 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.558+0000 7f18429da640 1 Processor -- start 2024-09-11T01:58:09.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.558+0000 7f18429da640 1 -- start start 2024-09-11T01:58:09.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.558+0000 7f18429da640 10 monclient: init 2024-09-11T01:58:09.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 10 monclient: _add_conns ranks=[5,4,0,2,7,3,1,8,6] 2024-09-11T01:58:09.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 10 monclient(hunting): picked mon.noname-h con 0x7f183c138960 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:09.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 10 monclient(hunting): picked mon.noname-c con 0x7f183c139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:09.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 10 monclient(hunting): picked mon.noname-a con 0x7f183c13f620 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:09.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c09d030 con 0x7f183c13f620 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c09d310 con 0x7f183c139450 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c06f770 con 0x7f183c138960 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 10 monclient(hunting): authenticate will time out at 733.004168s 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183bfff640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7f183c138960 0x7f183c138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.203:60072/0 (socket says 172.21.15.203:60072) 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183bfff640 1 -- 172.21.15.203:0/2543807230 learned_addr learned my addr 172.21.15.203:0/2543807230 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 -- 172.21.15.203:0/2543807230 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392622641 0 0) 0x7f183c06f770 con 0x7f183c138960 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient(hunting): my global_id is 4118 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 -- 172.21.15.203:0/2543807230 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1828003520 con 0x7f183c138960 2024-09-11T01:58:09.570 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 -- 172.21.15.203:0/2543807230 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4135152520 0 0) 0x7f1828003520 con 0x7f183c138960 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 -- 172.21.15.203:0/2543807230 >> v1:172.21.15.73:6791/0 conn(0x7f183c139450 legacy=0x7f183c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 -- 172.21.15.203:0/2543807230 >> v1:172.21.15.73:6789/0 conn(0x7f183c13f620 legacy=0x7f183c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 monclient: found mon.noname-h 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.203:6791/0 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 -- 172.21.15.203:0/2543807230 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c0a7360 con 0x7f183c138960 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 -- 172.21.15.203:0/2543807230 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1824001830 con 0x7f183c138960 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T01:58:09.571 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: dump: 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.572 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 5 monclient: authenticate success, global_id 4118 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 -- 172.21.15.203:0/2543807230 <== mon.5 v1:172.21.15.203:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1824001a50 con 0x7f183c138960 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 1 -- 172.21.15.203:0/2543807230 <== mon.5 v1:172.21.15.203:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1824001d40 con 0x7f183c138960 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f183affd640 10 monclient: dump: 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.573 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.574 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.559+0000 7f18429da640 4 set_mon_vals no callback set 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.560+0000 7f18429da640 10 monclient: shutdown 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.560+0000 7f18429da640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.560+0000 7f18429da640 1 -- 172.21.15.203:0/2543807230 >> v1:172.21.15.203:6791/0 conn(0x7f183c138960 legacy=0x7f183c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.560+0000 7f18429da640 1 -- 172.21.15.203:0/2543807230 shutdown_connections 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.560+0000 7f18429da640 1 -- 172.21.15.203:0/2543807230 >> 172.21.15.203:0/2543807230 conn(0x7f183c0a8050 msgr2=0x7f183c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.560+0000 7f18429da640 1 -- 172.21.15.203:0/2543807230 shutdown_connections 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.560+0000 7f18429da640 1 -- 172.21.15.203:0/2543807230 wait complete. 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.561+0000 7f18429da640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.561+0000 7f18429da640 10 monclient: monmap: 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 0.000000 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:created 0.000000 2024-09-11T01:58:09.575 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 1 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.561+0000 7f18429da640 1 Processor -- start 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.561+0000 7f18429da640 1 -- start start 2024-09-11T01:58:09.576 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.561+0000 7f18429da640 10 monclient: init 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 10 monclient: _add_conns ranks=[1,4,3,6,0,8,7,5,2] 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 10 monclient(hunting): picked mon.noname-f con 0x7f183c138960 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 10 monclient(hunting): picked mon.noname-c con 0x7f183c139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 10 monclient(hunting): picked mon.noname-g con 0x7f183c13f620 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c0a51a0 con 0x7f183c138960 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c13f250 con 0x7f183c13f620 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f183c138fd0 con 0x7f183c139450 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f18429da640 10 monclient(hunting): authenticate will time out at 733.007343s 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f183bfff640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f183c138960 0x7f183c13e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:54380/0 (socket says 172.21.15.203:54380) 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f183bfff640 1 -- 172.21.15.203:0/2298133439 learned_addr learned my addr 172.21.15.203:0/2298133439 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.577 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134002728 0 0) 0x7f183c13f250 con 0x7f183c13f620 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): my global_id is 4134 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f181c003520 con 0x7f183c13f620 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393933111 0 0) 0x7f183c0a51a0 con 0x7f183c138960 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): my global_id is 4123 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f183c13f250 con 0x7f183c138960 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117095099 0 0) 0x7f183c138fd0 con 0x7f183c139450 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.578 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): my global_id is 4144 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f183c0a51a0 con 0x7f183c139450 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1558182835 0 0) 0x7f181c003520 con 0x7f183c13f620 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f183c138fd0 con 0x7f183c13f620 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1834001d30 con 0x7f183c13f620 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.579 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:09.580 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1668926758 0 0) 0x7f183c0a51a0 con 0x7f183c139450 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.562+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f181c003520 con 0x7f183c139450 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2670080769 0 0) 0x7f183c13f250 con 0x7f183c138960 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f183c0a51a0 con 0x7f183c138960 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f182c001990 con 0x7f183c139450 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f18240017f0 con 0x7f183c138960 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.582 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.583 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3444925344 0 0) 0x7f183c138fd0 con 0x7f183c13f620 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 >> v1:172.21.15.73:6791/0 conn(0x7f183c139450 legacy=0x7f183c1d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 >> v1:172.21.15.203:6789/0 conn(0x7f183c138960 legacy=0x7f183c13e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 monclient: found mon.g 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.203:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c13cb40 con 0x7f183c13f620 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f18429da640 5 monclient: authenticate success, global_id 4134 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f18429da640 10 monclient: _renew_subs 2024-09-11T01:58:09.584 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f18429da640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f18429da640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.203:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f183c13b340 con 0x7f183c13f620 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f18429da640 10 monclient: _renew_subs 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f18429da640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f18429da640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.203:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f183c13a1a0 con 0x7f183c13f620 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1834002030 con 0x7f183c13f620 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1834003f80 con 0x7f183c13f620 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 10 monclient: dump: 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.585 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f183a7fc640 4 set_mon_vals no callback set 2024-09-11T01:58:09.586 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f1834004570 con 0x7f183c13f620 2024-09-11T01:58:09.587 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.563+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 8 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (unknown 378252479 0 0) 0x7f1834005c10 con 0x7f183c13f620 2024-09-11T01:58:09.587 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.564+0000 7f18429da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.587 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.564+0000 7f18429da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.587 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.564+0000 7f18429da640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.587 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.564+0000 7f18429da640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.203:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1820005080 con 0x7f183c13f620 2024-09-11T01:58:09.587 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.566+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (unknown 1092875540 0 2798735707) 0x7f18340057f0 con 0x7f183c13f620 2024-09-11T01:58:09.587 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.566+0000 7f1838ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.587 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.566+0000 7f1838ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:09.642 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.639+0000 7f18429da640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "063c664b-ce58-42bd-bd80-0d6b9721fcb4", "id": 2}] 2024-09-11T01:58:09.642 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.639+0000 7f18429da640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "063c664b-ce58-42bd-bd80-0d6b9721fcb4", "id": 2}] 2024-09-11T01:58:09.642 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.639+0000 7f18429da640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:09.642 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.639+0000 7f18429da640 1 -- 172.21.15.203:0/2298133439 --> v1:172.21.15.203:6790/0 -- mon_command({"prefix": "osd new", "uuid": "063c664b-ce58-42bd-bd80-0d6b9721fcb4", "id": 2} v 0) -- 0x7f1820005370 con 0x7f183c13f620 2024-09-11T01:58:09.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.647+0000 7f1838ff9640 1 -- 172.21.15.203:0/2298133439 <== mon.3 v1:172.21.15.203:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "063c664b-ce58-42bd-bd80-0d6b9721fcb4", "id": 2}]=0 v5) ==== 112+0+2 (unknown 2712265161 0 216599125) 0x7f1834004a60 con 0x7f183c13f620 2024-09-11T01:58:09.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.647+0000 7f1838ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "063c664b-ce58-42bd-bd80-0d6b9721fcb4", "id": 2}] 2024-09-11T01:58:09.650 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.647+0000 7f1838ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:2 2024-09-11T01:58:09.651 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.648+0000 7f18429da640 10 monclient: shutdown 2024-09-11T01:58:09.651 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.648+0000 7f18429da640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:09.651 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.648+0000 7f18429da640 1 -- 172.21.15.203:0/2298133439 >> v1:172.21.15.203:6790/0 conn(0x7f183c13f620 legacy=0x7f183c1d5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.652 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.648+0000 7f18429da640 1 -- 172.21.15.203:0/2298133439 shutdown_connections 2024-09-11T01:58:09.652 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.648+0000 7f18429da640 1 -- 172.21.15.203:0/2298133439 >> 172.21.15.203:0/2298133439 conn(0x7f183c0a8050 msgr2=0x7f183c0a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:09.652 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.649+0000 7f18429da640 1 -- 172.21.15.203:0/2298133439 shutdown_connections 2024-09-11T01:58:09.652 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.649+0000 7f18429da640 1 -- 172.21.15.203:0/2298133439 wait complete. 2024-09-11T01:58:09.661 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 12d01ea7-7a0e-4b5a-ac25-a6ba6af66458 3 2024-09-11T01:58:09.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.755+0000 7fb5bd8b0640 10 monclient: get_monmap_and_config 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.755+0000 7fb5bd8b0640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.755+0000 7fb5bd8b0640 10 monclient: monmap: 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:58:09.757828+0000 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:58:09.757828+0000 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.759 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.760 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.760 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.760 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.760 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.760 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.760 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.760 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.760 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.770 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.756+0000 7fb5bd8b0640 1 Processor -- start 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.756+0000 7fb5bd8b0640 1 -- start start 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.756+0000 7fb5bd8b0640 10 monclient: init 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 10 monclient: _add_conns ranks=[2,4,8,1,5,3,0,7,6] 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 10 monclient(hunting): picked mon.noname-b con 0x7fb5b81379e0 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 10 monclient(hunting): picked mon.noname-c con 0x7fb5b8137dc0 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 10 monclient(hunting): picked mon.noname-e con 0x7fb5b8138210 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b806cd00 con 0x7fb5b81379e0 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b809d550 con 0x7fb5b8137dc0 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b809d830 con 0x7fb5b8138210 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5bd8b0640 10 monclient(hunting): authenticate will time out at 733.202337s 2024-09-11T01:58:09.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b6ffd640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb5b81379e0 0x7fb5b809dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.203:52918/0 (socket says 172.21.15.203:52918) 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5affff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fb5b8137dc0 0x7fb5b813daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.203:33668/0 (socket says 172.21.15.203:33668) 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b6ffd640 1 -- 172.21.15.203:0/1000818437 learned_addr learned my addr 172.21.15.203:0/1000818437 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b77fe640 1 --1- 172.21.15.203:0/1000818437 >> v1:172.21.15.73:6793/0 conn(0x7fb5b8138210 0x7fb5b81411d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.203:56340/0 (socket says 172.21.15.203:56340) 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610569059 0 0) 0x7fb5b809d550 con 0x7fb5b8137dc0 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): my global_id is 4153 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5a4003520 con 0x7fb5b8137dc0 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424899052 0 0) 0x7fb5a8001110 con 0x7fb5b81379e0 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.772 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): my global_id is 4124 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b809d550 con 0x7fb5b81379e0 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35292665 0 0) 0x7fb5b809d830 con 0x7fb5b8138210 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 10 monclient(hunting): my global_id is 4130 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.757+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5a8001110 con 0x7fb5b8138210 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2188102231 0 0) 0x7fb5a4003520 con 0x7fb5b8137dc0 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 >> v1:172.21.15.73:6793/0 conn(0x7fb5b8138210 legacy=0x7fb5b81411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 >> v1:172.21.15.73:6790/0 conn(0x7fb5b81379e0 legacy=0x7fb5b809dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.773 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 1 monclient: found mon.noname-c 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b806d5e0 con 0x7fb5b8137dc0 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb5a0001830 con 0x7fb5b8137dc0 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 5 monclient: authenticate success, global_id 4153 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: dump: 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.774 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.775 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5a0001a50 con 0x7fb5b8137dc0 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 1 -- 172.21.15.203:0/1000818437 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb5a0001d40 con 0x7fb5b8137dc0 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 4 set_mon_vals no callback set 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5b67fc640 10 monclient: dump: 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.776 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.777 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 10 monclient: shutdown 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/1000818437 >> v1:172.21.15.73:6791/0 conn(0x7fb5b8137dc0 legacy=0x7fb5b813daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/1000818437 shutdown_connections 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/1000818437 >> 172.21.15.203:0/1000818437 conn(0x7fb5b80a54d0 msgr2=0x7fb5b80688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/1000818437 shutdown_connections 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.758+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/1000818437 wait complete. 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.759+0000 7fb5bd8b0640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.759+0000 7fb5bd8b0640 10 monclient: monmap: 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 0.000000 2024-09-11T01:58:09.778 INFO:teuthology.orchestra.run.smithi203.stderr:created 0.000000 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 1 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.779 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.759+0000 7fb5bd8b0640 1 Processor -- start 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.759+0000 7fb5bd8b0640 1 -- start start 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.759+0000 7fb5bd8b0640 10 monclient: init 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 10 monclient: _add_conns ranks=[4,6,3,1,5,2,0,8,7] 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 10 monclient(hunting): picked mon.noname-c con 0x7fb5b81379e0 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 10 monclient(hunting): picked mon.noname-d con 0x7fb5b8137dc0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 10 monclient(hunting): picked mon.noname-g con 0x7fb5b8138210 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b80a7010 con 0x7fb5b8138210 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b81355f0 con 0x7fb5b81379e0 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5b8132e40 con 0x7fb5b8137dc0 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5bd8b0640 10 monclient(hunting): authenticate will time out at 733.205353s 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b77fe640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7fb5b8138210 0x7fb5b81d59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.203:49210/0 (socket says 172.21.15.203:49210) 2024-09-11T01:58:09.780 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b77fe640 1 -- 172.21.15.203:0/4229769811 learned_addr learned my addr 172.21.15.203:0/4229769811 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587597665 0 0) 0x7fb5a8001110 con 0x7fb5b8138210 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): my global_id is 4143 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb598003550 con 0x7fb5b8138210 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572441347 0 0) 0x7fb5b81355f0 con 0x7fb5b81379e0 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): my global_id is 4162 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5a8001110 con 0x7fb5b81379e0 2024-09-11T01:58:09.781 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 706971004 0 0) 0x7fb5b8132e40 con 0x7fb5b8137dc0 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 10 monclient(hunting): my global_id is 4110 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b81355f0 con 0x7fb5b8137dc0 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4228491623 0 0) 0x7fb5a8001110 con 0x7fb5b81379e0 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5b8132e40 con 0x7fb5b81379e0 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.760+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 903475475 0 0) 0x7fb598003550 con 0x7fb5b8138210 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5a8001110 con 0x7fb5b8138210 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb5a8001c60 con 0x7fb5b81379e0 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:09.782 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.783 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb5b0001cb0 con 0x7fb5b8138210 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.784 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3650179670 0 0) 0x7fb5b81355f0 con 0x7fb5b8137dc0 2024-09-11T01:58:09.785 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb598003550 con 0x7fb5b8137dc0 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb5a00017f0 con 0x7fb5b8137dc0 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.786 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 289720827 0 0) 0x7fb5b8132e40 con 0x7fb5b81379e0 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 >> v1:172.21.15.73:6792/0 conn(0x7fb5b8137dc0 legacy=0x7fb5b8132730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 >> v1:172.21.15.203:6790/0 conn(0x7fb5b8138210 legacy=0x7fb5b81d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 monclient: found mon.c 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:09.787 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b81343b0 con 0x7fb5b81379e0 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5bd8b0640 5 monclient: authenticate success, global_id 4162 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5bd8b0640 10 monclient: _renew_subs 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5bd8b0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b81358d0 con 0x7fb5b81379e0 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5bd8b0640 10 monclient: _renew_subs 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5bd8b0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5b80a6500 con 0x7fb5b81379e0 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5a8004b00 con 0x7fb5b81379e0 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.788 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb5a8005030 con 0x7fb5b81379e0 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b5ffb640 4 set_mon_vals no callback set 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 10 monclient: dump: 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.789 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7fb5a80055e0 con 0x7fb5b81379e0 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.761+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (unknown 864749227 0 0) 0x7fb5a8006d30 con 0x7fb5b81379e0 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.762+0000 7fb5bd8b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.762+0000 7fb5bd8b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.762+0000 7fb5bd8b0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.762+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb59c005080 con 0x7fb5b81379e0 2024-09-11T01:58:09.790 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.764+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (unknown 1092875540 0 2798735707) 0x7fb5b806cd00 con 0x7fb5b81379e0 2024-09-11T01:58:09.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.764+0000 7fb5b4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.791 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.764+0000 7fb5b4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:09.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.834+0000 7fb5bd8b0640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "12d01ea7-7a0e-4b5a-ac25-a6ba6af66458", "id": 3}] 2024-09-11T01:58:09.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.834+0000 7fb5bd8b0640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "12d01ea7-7a0e-4b5a-ac25-a6ba6af66458", "id": 3}] 2024-09-11T01:58:09.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.834+0000 7fb5bd8b0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:09.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.834+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/4229769811 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "osd new", "uuid": "12d01ea7-7a0e-4b5a-ac25-a6ba6af66458", "id": 3} v 0) -- 0x7fb59c005370 con 0x7fb5b81379e0 2024-09-11T01:58:09.842 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.839+0000 7fb5b4ff9640 1 -- 172.21.15.203:0/4229769811 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12d01ea7-7a0e-4b5a-ac25-a6ba6af66458", "id": 3}]=0 v6) ==== 112+0+2 (unknown 3706864898 0 525046306) 0x7fb5a8006a80 con 0x7fb5b81379e0 2024-09-11T01:58:09.842 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.839+0000 7fb5b4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "12d01ea7-7a0e-4b5a-ac25-a6ba6af66458", "id": 3}] 2024-09-11T01:58:09.842 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.839+0000 7fb5b4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:09.842 INFO:teuthology.orchestra.run.smithi203.stdout:3 2024-09-11T01:58:09.843 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.841+0000 7fb5bd8b0640 10 monclient: shutdown 2024-09-11T01:58:09.844 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.841+0000 7fb5bd8b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:09.844 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.841+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/4229769811 >> v1:172.21.15.73:6791/0 conn(0x7fb5b81379e0 legacy=0x7fb5b8132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.844 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.841+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/4229769811 shutdown_connections 2024-09-11T01:58:09.844 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.841+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/4229769811 >> 172.21.15.203:0/4229769811 conn(0x7fb5b80a54d0 msgr2=0x7fb5b80a3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:09.844 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.841+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/4229769811 shutdown_connections 2024-09-11T01:58:09.844 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.841+0000 7fb5bd8b0640 1 -- 172.21.15.203:0/4229769811 wait complete. 2024-09-11T01:58:09.854 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 8b89af16-5602-4527-ba2c-b7142acac9a1 4 2024-09-11T01:58:09.953 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.951+0000 7fc475623640 10 monclient: get_monmap_and_config 2024-09-11T01:58:09.953 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.951+0000 7fc475623640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.953 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.951+0000 7fc475623640 10 monclient: monmap: 2024-09-11T01:58:09.953 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.953 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.953 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:58:09.952056+0000 2024-09-11T01:58:09.953 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:58:09.952056+0000 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.951+0000 7fc475623640 1 Processor -- start 2024-09-11T01:58:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.951+0000 7fc475623640 1 -- start start 2024-09-11T01:58:09.955 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.951+0000 7fc475623640 10 monclient: init 2024-09-11T01:58:09.961 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 10 monclient: _add_conns ranks=[1,4,6,2,7,5,3,0,8] 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 10 monclient(hunting): picked mon.noname-f con 0x7fc470138960 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 10 monclient(hunting): picked mon.noname-c con 0x7fc470139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 10 monclient(hunting): picked mon.noname-d con 0x7fc47013f620 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47009d030 con 0x7fc470138960 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47009d310 con 0x7fc470139450 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47006f770 con 0x7fc47013f620 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 10 monclient(hunting): authenticate will time out at 733.396400s 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46effd640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fc470138960 0x7fc470138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:54394/0 (socket says 172.21.15.203:54394) 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46effd640 1 -- 172.21.15.203:0/39387797 learned_addr learned my addr 172.21.15.203:0/39387797 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 1 -- 172.21.15.203:0/39387797 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075020658 0 0) 0x7fc47009d030 con 0x7fc470138960 2024-09-11T01:58:09.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient(hunting): my global_id is 4132 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 1 -- 172.21.15.203:0/39387797 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc45c003520 con 0x7fc470138960 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 1 -- 172.21.15.203:0/39387797 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 356751760 0 0) 0x7fc45c003520 con 0x7fc470138960 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 1 -- 172.21.15.203:0/39387797 >> v1:172.21.15.73:6792/0 conn(0x7fc47013f620 legacy=0x7fc470141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 1 -- 172.21.15.203:0/39387797 >> v1:172.21.15.73:6791/0 conn(0x7fc470139450 legacy=0x7fc47013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 1 monclient: found mon.noname-f 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.203:6789/0 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 1 -- 172.21.15.203:0/39387797 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4700a7360 con 0x7fc470138960 2024-09-11T01:58:09.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 5 monclient: authenticate success, global_id 4132 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 1 -- 172.21.15.203:0/39387797 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc460001830 con 0x7fc470138960 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc475623640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.952+0000 7fc46dffb640 10 monclient: dump: 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.964 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.965 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc46dffb640 1 -- 172.21.15.203:0/39387797 <== mon.1 v1:172.21.15.203:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc460001a50 con 0x7fc470138960 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc46dffb640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc46dffb640 1 -- 172.21.15.203:0/39387797 <== mon.1 v1:172.21.15.203:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc460001d40 con 0x7fc470138960 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc46dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 4 set_mon_vals no callback set 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc46dffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc46dffb640 10 monclient: dump: 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.966 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.967 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 10 monclient: shutdown 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 1 -- 172.21.15.203:0/39387797 >> v1:172.21.15.203:6789/0 conn(0x7fc470138960 legacy=0x7fc470138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 1 -- 172.21.15.203:0/39387797 shutdown_connections 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 1 -- 172.21.15.203:0/39387797 >> 172.21.15.203:0/39387797 conn(0x7fc4700a8050 msgr2=0x7fc4700a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 1 -- 172.21.15.203:0/39387797 shutdown_connections 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.953+0000 7fc475623640 1 -- 172.21.15.203:0/39387797 wait complete. 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.954+0000 7fc475623640 10 monclient: build_initial_monmap 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.954+0000 7fc475623640 10 monclient: monmap: 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 0.000000 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:created 0.000000 2024-09-11T01:58:09.968 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 1 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.969 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.954+0000 7fc475623640 1 Processor -- start 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.954+0000 7fc475623640 1 -- start start 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.954+0000 7fc475623640 10 monclient: init 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 10 monclient: _add_conns ranks=[8,4,0,7,3,5,6,1,2] 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 10 monclient(hunting): picked mon.noname-e con 0x7fc470138960 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 10 monclient(hunting): picked mon.noname-c con 0x7fc470139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 10 monclient(hunting): picked mon.noname-a con 0x7fc47013f620 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc470142cc0 con 0x7fc47013f620 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4700a1ca0 con 0x7fc470139450 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47013c1e0 con 0x7fc470138960 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc475623640 10 monclient(hunting): authenticate will time out at 733.399189s 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc46effd640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fc470138960 0x7fc47013dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.203:56350/0 (socket says 172.21.15.203:56350) 2024-09-11T01:58:09.970 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc46effd640 1 -- 172.21.15.203:0/2667796748 learned_addr learned my addr 172.21.15.203:0/2667796748 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231386771 0 0) 0x7fc47013c1e0 con 0x7fc470138960 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): my global_id is 4139 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc450003520 con 0x7fc470138960 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3739916429 0 0) 0x7fc470142cc0 con 0x7fc47013f620 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): my global_id is 4140 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc47013c1e0 con 0x7fc47013f620 2024-09-11T01:58:09.971 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263022561 0 0) 0x7fc4700a1ca0 con 0x7fc470139450 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): my global_id is 4180 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc470142cc0 con 0x7fc470139450 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1741114701 0 0) 0x7fc450003520 con 0x7fc470138960 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4700a1ca0 con 0x7fc470138960 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc4600017f0 con 0x7fc470138960 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): dump: 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.972 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.973 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2848101600 0 0) 0x7fc47013c1e0 con 0x7fc47013f620 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc450003520 con 0x7fc47013f620 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc468001cb0 con 0x7fc47013f620 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): dump: 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.974 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1698384230 0 0) 0x7fc470142cc0 con 0x7fc470139450 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc47013c1e0 con 0x7fc470139450 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc458001990 con 0x7fc470139450 2024-09-11T01:58:09.975 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.955+0000 7fc4677fe640 10 monclient(hunting): dump: 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.976 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1524470061 0 0) 0x7fc4700a1ca0 con 0x7fc470138960 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 >> v1:172.21.15.73:6791/0 conn(0x7fc470139450 legacy=0x7fc4701d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 >> v1:172.21.15.73:6789/0 conn(0x7fc47013f620 legacy=0x7fc4701d5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 1 monclient: found mon.e 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47013ee50 con 0x7fc470138960 2024-09-11T01:58:09.977 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc475623640 5 monclient: authenticate success, global_id 4139 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc475623640 10 monclient: _renew_subs 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc475623640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc475623640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc4701cd860 con 0x7fc470138960 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc475623640 10 monclient: _renew_subs 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc475623640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc475623640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fc47013e8a0 con 0x7fc470138960 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4600011f0 con 0x7fc470138960 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc460001a10 con 0x7fc470138960 2024-09-11T01:58:09.978 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 10 monclient: dump: 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:09.979 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7fc460005680 con 0x7fc470138960 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc46d7fa640 4 set_mon_vals no callback set 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (unknown 273389788 0 0) 0x7fc460006cf0 con 0x7fc470138960 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc475623640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.956+0000 7fc475623640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.957+0000 7fc475623640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:09.980 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.957+0000 7fc475623640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc454005080 con 0x7fc470138960 2024-09-11T01:58:09.981 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.959+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (unknown 1092875540 0 2798735707) 0x7fc4600067e0 con 0x7fc470138960 2024-09-11T01:58:09.981 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.959+0000 7fc4677fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:09.981 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:09.959+0000 7fc4677fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:10.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.030+0000 7fc475623640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8b89af16-5602-4527-ba2c-b7142acac9a1", "id": 4}] 2024-09-11T01:58:10.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.030+0000 7fc475623640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8b89af16-5602-4527-ba2c-b7142acac9a1", "id": 4}] 2024-09-11T01:58:10.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.030+0000 7fc475623640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:10.032 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.030+0000 7fc475623640 1 -- 172.21.15.203:0/2667796748 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "osd new", "uuid": "8b89af16-5602-4527-ba2c-b7142acac9a1", "id": 4} v 0) -- 0x7fc454005370 con 0x7fc470138960 2024-09-11T01:58:10.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.037+0000 7fc4677fe640 1 -- 172.21.15.203:0/2667796748 <== mon.8 v1:172.21.15.73:6793/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b89af16-5602-4527-ba2c-b7142acac9a1", "id": 4}]=0 v7) ==== 112+0+2 (unknown 2583046452 0 1697012583) 0x7fc460006b10 con 0x7fc470138960 2024-09-11T01:58:10.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.037+0000 7fc4677fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8b89af16-5602-4527-ba2c-b7142acac9a1", "id": 4}] 2024-09-11T01:58:10.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.037+0000 7fc4677fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:10.039 INFO:teuthology.orchestra.run.smithi203.stdout:4 2024-09-11T01:58:10.040 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.038+0000 7fc475623640 10 monclient: shutdown 2024-09-11T01:58:10.040 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.038+0000 7fc475623640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:10.040 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.038+0000 7fc475623640 1 -- 172.21.15.203:0/2667796748 >> v1:172.21.15.73:6793/0 conn(0x7fc470138960 legacy=0x7fc47013dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.040 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.038+0000 7fc475623640 1 -- 172.21.15.203:0/2667796748 shutdown_connections 2024-09-11T01:58:10.040 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.038+0000 7fc475623640 1 -- 172.21.15.203:0/2667796748 >> 172.21.15.203:0/2667796748 conn(0x7fc4700a8050 msgr2=0x7fc470141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:10.040 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.038+0000 7fc475623640 1 -- 172.21.15.203:0/2667796748 shutdown_connections 2024-09-11T01:58:10.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.038+0000 7fc475623640 1 -- 172.21.15.203:0/2667796748 wait complete. 2024-09-11T01:58:10.052 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new ae991c5c-eac0-4bd2-8d87-7efa36a62abb 5 2024-09-11T01:58:10.150 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.148+0000 7f30775c2640 10 monclient: get_monmap_and_config 2024-09-11T01:58:10.150 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.148+0000 7f30775c2640 10 monclient: build_initial_monmap 2024-09-11T01:58:10.150 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.148+0000 7f30775c2640 10 monclient: monmap: 2024-09-11T01:58:10.150 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:10.150 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.150 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:58:10.149153+0000 2024-09-11T01:58:10.150 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:58:10.149153+0000 2024-09-11T01:58:10.150 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:10.150 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.148+0000 7f30775c2640 1 Processor -- start 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 1 -- start start 2024-09-11T01:58:10.151 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 10 monclient: init 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 10 monclient: _add_conns ranks=[6,7,1,3,4,2,8,0,5] 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 10 monclient(hunting): picked mon.noname-d con 0x7f30701379e0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 10 monclient(hunting): picked mon.noname-i con 0x7f3070137dc0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 10 monclient(hunting): picked mon.noname-f con 0x7f3070138210 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307006cd00 con 0x7f3070138210 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307009d550 con 0x7f30701379e0 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307009d830 con 0x7f3070137dc0 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f30775c2640 10 monclient(hunting): authenticate will time out at 733.593598s 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3074b5d640 1 --1- >> v1:172.21.15.203:6792/0 conn(0x7f3070137dc0 0x7f307013daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6792/0 says I am v1:172.21.15.203:47010/0 (socket says 172.21.15.203:47010) 2024-09-11T01:58:10.159 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3074b5d640 1 -- 172.21.15.203:0/413176704 learned_addr learned my addr 172.21.15.203:0/413176704 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002548670 0 0) 0x7f307009d830 con 0x7f3070137dc0 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 10 monclient(hunting): my global_id is 4138 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f305c003520 con 0x7f3070137dc0 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028533583 0 0) 0x7f3068001490 con 0x7f3070138210 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.160 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 10 monclient(hunting): my global_id is 4141 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.149+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f307009d830 con 0x7f3070138210 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2981907587 0 0) 0x7f305c003520 con 0x7f3070137dc0 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 >> v1:172.21.15.73:6792/0 conn(0x7f30701379e0 legacy=0x7f307009dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 >> v1:172.21.15.203:6789/0 conn(0x7f3070138210 legacy=0x7f30701411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 1 monclient: found mon.noname-i 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.203:6792/0 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 --> v1:172.21.15.203:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307006d5e0 con 0x7f3070137dc0 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: _finish_auth 0 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 5 monclient: authenticate success, global_id 4138 2024-09-11T01:58:10.161 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f306c001760 con 0x7f3070137dc0 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: dump: 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.162 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 <== mon.7 v1:172.21.15.203:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f306c001980 con 0x7f3070137dc0 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 4 set_mon_vals no callback set 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 1 -- 172.21.15.203:0/413176704 <== mon.7 v1:172.21.15.203:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f306c004be0 con 0x7f3070137dc0 2024-09-11T01:58:10.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f3063fff640 10 monclient: dump: 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.164 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 10 monclient: shutdown 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 1 -- 172.21.15.203:0/413176704 >> v1:172.21.15.203:6792/0 conn(0x7f3070137dc0 legacy=0x7f307013daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 1 -- 172.21.15.203:0/413176704 shutdown_connections 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 1 -- 172.21.15.203:0/413176704 >> 172.21.15.203:0/413176704 conn(0x7f30700a54d0 msgr2=0x7f30700688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 1 -- 172.21.15.203:0/413176704 shutdown_connections 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.150+0000 7f30775c2640 1 -- 172.21.15.203:0/413176704 wait complete. 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.151+0000 7f30775c2640 10 monclient: build_initial_monmap 2024-09-11T01:58:10.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.151+0000 7f30775c2640 10 monclient: monmap: 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 0 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 0.000000 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:created 0.000000 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 1 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:10.166 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.151+0000 7f30775c2640 1 Processor -- start 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.151+0000 7f30775c2640 1 -- start start 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.151+0000 7f30775c2640 10 monclient: init 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 10 monclient: _add_conns ranks=[2,0,5,7,1,4,8,6,3] 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 10 monclient(hunting): picked mon.noname-b con 0x7f30701379e0 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 10 monclient(hunting): picked mon.noname-a con 0x7f3070137dc0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 10 monclient(hunting): picked mon.noname-h con 0x7f3070138210 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30701397c0 con 0x7f3070137dc0 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3070135ac0 con 0x7f30701379e0 2024-09-11T01:58:10.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30701394e0 con 0x7f3070138210 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f30775c2640 10 monclient(hunting): authenticate will time out at 733.596372s 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3075b5f640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7f3070138210 0x7f30701d59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.203:60080/0 (socket says 172.21.15.203:60080) 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3075b5f640 1 -- 172.21.15.203:0/4201642274 learned_addr learned my addr 172.21.15.203:0/4201642274 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754162581 0 0) 0x7f30701394e0 con 0x7f3070138210 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): my global_id is 4127 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3054003520 con 0x7f3070138210 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532753691 0 0) 0x7f30701397c0 con 0x7f3070137dc0 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.168 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): my global_id is 4149 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30701394e0 con 0x7f3070137dc0 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115306390 0 0) 0x7f3070135ac0 con 0x7f30701379e0 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): my global_id is 4133 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30701397c0 con 0x7f30701379e0 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3838873964 0 0) 0x7f3054003520 con 0x7f3070138210 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3070135ac0 con 0x7f3070138210 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3068001ac0 con 0x7f3070138210 2024-09-11T01:58:10.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.152+0000 7f3061ffb640 10 monclient(hunting): dump: 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.170 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1004368760 0 0) 0x7f30701394e0 con 0x7f3070137dc0 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3054003520 con 0x7f3070137dc0 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f306c001720 con 0x7f3070137dc0 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient(hunting): dump: 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.171 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2981470989 0 0) 0x7f30701397c0 con 0x7f30701379e0 2024-09-11T01:58:10.172 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30701394e0 con 0x7f30701379e0 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3064001950 con 0x7f30701379e0 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient(hunting): dump: 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.173 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 615256117 0 0) 0x7f3070135ac0 con 0x7f3070138210 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 >> v1:172.21.15.73:6790/0 conn(0x7f30701379e0 legacy=0x7f3070134ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 >> v1:172.21.15.73:6789/0 conn(0x7f3070137dc0 legacy=0x7f30701353b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient: _finish_hunting 0 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 monclient: found mon.h 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3070142350 con 0x7f3070138210 2024-09-11T01:58:10.174 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient: _finish_auth 0 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient: _check_auth_tickets 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f30775c2640 5 monclient: authenticate success, global_id 4127 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f30775c2640 10 monclient: _renew_subs 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f30775c2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f30775c2640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.203:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f30701425e0 con 0x7f3070138210 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3068003c20 con 0x7f3070138210 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f30680041d0 con 0x7f3070138210 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 10 monclient: dump: 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:epoch 1 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.175 INFO:teuthology.orchestra.run.smithi203.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:election_strategy: 3 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f30775c2640 10 monclient: _renew_subs 2024-09-11T01:58:10.176 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f30637fe640 4 set_mon_vals no callback set 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f30775c2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f30775c2640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.203:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f30701d72b0 con 0x7f3070138210 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7f3068005b00 con 0x7f3070138210 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.153+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 8 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (unknown 1362559047 0 0) 0x7f30680063a0 con 0x7f3070138210 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.154+0000 7f30775c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.154+0000 7f30775c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.154+0000 7f30775c2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.154+0000 7f30775c2640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.203:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3070136790 con 0x7f3070138210 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.156+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (unknown 1092875540 0 2798735707) 0x7f3070136790 con 0x7f3070138210 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.156+0000 7f3061ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:10.177 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.156+0000 7f3061ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:10.229 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.227+0000 7f30775c2640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ae991c5c-eac0-4bd2-8d87-7efa36a62abb", "id": 5}] 2024-09-11T01:58:10.229 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.227+0000 7f30775c2640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ae991c5c-eac0-4bd2-8d87-7efa36a62abb", "id": 5}] 2024-09-11T01:58:10.229 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.227+0000 7f30775c2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:10.229 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.227+0000 7f30775c2640 1 -- 172.21.15.203:0/4201642274 --> v1:172.21.15.203:6791/0 -- mon_command({"prefix": "osd new", "uuid": "ae991c5c-eac0-4bd2-8d87-7efa36a62abb", "id": 5} v 0) -- 0x7f30700a22d0 con 0x7f3070138210 2024-09-11T01:58:10.232 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.231+0000 7f3061ffb640 1 -- 172.21.15.203:0/4201642274 <== mon.5 v1:172.21.15.203:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae991c5c-eac0-4bd2-8d87-7efa36a62abb", "id": 5}]=0 v8) ==== 112+0+2 (unknown 1567477815 0 1988412176) 0x7f307006cd00 con 0x7f3070138210 2024-09-11T01:58:10.232 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.231+0000 7f3061ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ae991c5c-eac0-4bd2-8d87-7efa36a62abb", "id": 5}] 2024-09-11T01:58:10.233 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.231+0000 7f3061ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:10.233 INFO:teuthology.orchestra.run.smithi203.stdout:5 2024-09-11T01:58:10.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.232+0000 7f30775c2640 10 monclient: shutdown 2024-09-11T01:58:10.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.232+0000 7f30775c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:10.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.232+0000 7f30775c2640 1 -- 172.21.15.203:0/4201642274 >> v1:172.21.15.203:6791/0 conn(0x7f3070138210 legacy=0x7f30701d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.232+0000 7f30775c2640 1 -- 172.21.15.203:0/4201642274 shutdown_connections 2024-09-11T01:58:10.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.232+0000 7f30775c2640 1 -- 172.21.15.203:0/4201642274 >> 172.21.15.203:0/4201642274 conn(0x7f30700a54d0 msgr2=0x7f307009f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:10.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.232+0000 7f30775c2640 1 -- 172.21.15.203:0/4201642274 shutdown_connections 2024-09-11T01:58:10.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-11T01:58:10.232+0000 7f30775c2640 1 -- 172.21.15.203:0/4201642274 wait complete. 2024-09-11T01:58:10.244 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T01:58:10.244 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T01:58:10.246 INFO:tasks.ceph.osd.0:Started 2024-09-11T01:58:10.246 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T01:58:10.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T01:58:10.248 INFO:tasks.ceph.osd.1:Started 2024-09-11T01:58:10.249 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T01:58:10.249 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T01:58:10.251 INFO:tasks.ceph.osd.2:Started 2024-09-11T01:58:10.251 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T01:58:10.251 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T01:58:10.253 INFO:tasks.ceph.osd.3:Started 2024-09-11T01:58:10.253 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T01:58:10.253 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T01:58:10.255 INFO:tasks.ceph.osd.4:Started 2024-09-11T01:58:10.256 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T01:58:10.256 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T01:58:10.258 INFO:tasks.ceph.osd.5:Started 2024-09-11T01:58:10.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.365+0000 7efdeedf8640 10 monclient: get_monmap_and_config 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.365+0000 7efdeedf8640 10 monclient: build_initial_monmap 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.365+0000 7efdeedf8640 10 monclient: monmap: 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:10.366439+0000 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:10.366439+0000 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:10.367 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:10.368 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:10.368 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:10.368 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:10.368 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:10.368 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:10.368 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:10.368 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:10.368 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:10.368 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 1 Processor -- start 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 1 -- start start 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 10 monclient: init 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 10 monclient: _add_conns ranks=[2,8,1,6,5,0,3,4,7] 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 10 monclient(hunting): picked mon.noname-b con 0x7efde8138d40 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 10 monclient(hunting): picked mon.noname-e con 0x7efde80a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 10 monclient(hunting): picked mon.noname-f con 0x7efde813f350 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde809ca00 con 0x7efde813f350 2024-09-11T01:58:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde80a7070 con 0x7efde8138d40 2024-09-11T01:58:10.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde809cee0 con 0x7efde80a72f0 2024-09-11T01:58:10.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:10.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdeedf8640 10 monclient(hunting): authenticate will time out at 731.970875s 2024-09-11T01:58:10.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdecb94640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7efde8138d40 0x7efde8139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:36576/0 (socket says 172.21.15.73:36576) 2024-09-11T01:58:10.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efdecb94640 1 -- 172.21.15.73:0/248681852 learned_addr learned my addr 172.21.15.73:0/248681852 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:10.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.366+0000 7efddffff640 1 --1- 172.21.15.73:0/248681852 >> v1:172.21.15.73:6793/0 conn(0x7efde80a72f0 0x7efde813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:44092/0 (socket says 172.21.15.73:44092) 2024-09-11T01:58:10.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193854281 0 0) 0x7efde80a7070 con 0x7efde8138d40 2024-09-11T01:58:10.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): my global_id is 4169 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdd0003520 con 0x7efde8138d40 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352285870 0 0) 0x7efde809cee0 con 0x7efde80a72f0 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): my global_id is 4166 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde80a7070 con 0x7efde80a72f0 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1710126646 0 0) 0x7efde809ca00 con 0x7efde813f350 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient(hunting): my global_id is 4168 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde809cee0 con 0x7efde813f350 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1955572452 0 0) 0x7efdd0003520 con 0x7efde8138d40 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 >> v1:172.21.15.73:6793/0 conn(0x7efde80a72f0 legacy=0x7efde813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 >> v1:172.21.15.203:6789/0 conn(0x7efde813f350 legacy=0x7efde8141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 monclient: found mon.noname-b 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde809d1c0 con 0x7efde8138d40 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efde4001bb0 con 0x7efde8138d40 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: dump: 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efdeedf8640 5 monclient: authenticate success, global_id 4169 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efdeedf8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efde4001dd0 con 0x7efde8138d40 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 1 -- 172.21.15.73:0/248681852 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efde4004f60 con 0x7efde8138d40 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efddf7fe640 10 monclient: dump: 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efdeedf8640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.367+0000 7efdeedf8640 4 set_mon_vals no callback set 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.368+0000 7efdeedf8640 10 monclient: shutdown 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.368+0000 7efdeedf8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.368+0000 7efdeedf8640 1 -- 172.21.15.73:0/248681852 >> v1:172.21.15.73:6790/0 conn(0x7efde8138d40 legacy=0x7efde8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.368+0000 7efdeedf8640 1 -- 172.21.15.73:0/248681852 shutdown_connections 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.368+0000 7efdeedf8640 1 -- 172.21.15.73:0/248681852 >> 172.21.15.73:0/248681852 conn(0x7efde80a8050 msgr2=0x7efde80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.368+0000 7efdeedf8640 1 -- 172.21.15.73:0/248681852 shutdown_connections 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.368+0000 7efdeedf8640 1 -- 172.21.15.73:0/248681852 wait complete. 2024-09-11T01:58:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.368+0000 7efdeedf8640 10 monclient: build_initial_monmap 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.368+0000 7efdeedf8640 10 monclient: monmap: 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:10.386 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 1 Processor -- start 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 1 -- start start 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 10 monclient: init 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 10 monclient: _add_conns ranks=[5,0,6,1,8,2,4,3,7] 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 10 monclient(hunting): picked mon.noname-h con 0x7efde80a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 10 monclient(hunting): picked mon.noname-a con 0x7efde8138d40 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 10 monclient(hunting): picked mon.noname-d con 0x7efde813f350 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde8142410 con 0x7efde8138d40 2024-09-11T01:58:10.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde8140550 con 0x7efde80a72f0 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde8142940 con 0x7efde813f350 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efdeedf8640 10 monclient(hunting): authenticate will time out at 731.973844s 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efddffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efde8138d40 0x7efde813fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52606/0 (socket says 172.21.15.73:52606) 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.369+0000 7efddffff640 1 -- 172.21.15.73:0/1333041339 learned_addr learned my addr 172.21.15.73:0/1333041339 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265840427 0 0) 0x7efde8142410 con 0x7efde8138d40 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): my global_id is 4176 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdd4003520 con 0x7efde8138d40 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106344846 0 0) 0x7efde8140550 con 0x7efde80a72f0 2024-09-11T01:58:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): my global_id is 4163 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde8142410 con 0x7efde80a72f0 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328321003 0 0) 0x7efde8142940 con 0x7efde813f350 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): my global_id is 4146 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efde8140550 con 0x7efde813f350 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2949091292 0 0) 0x7efdd4003520 con 0x7efde8138d40 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efde8142940 con 0x7efde8138d40 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efdd8001b10 con 0x7efde8138d40 2024-09-11T01:58:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.390 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2268285035 0 0) 0x7efde8142410 con 0x7efde80a72f0 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdd4003520 con 0x7efde80a72f0 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efde4004ea0 con 0x7efde80a72f0 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:10.391 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.392 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2855349113 0 0) 0x7efde8140550 con 0x7efde813f350 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efde8142410 con 0x7efde813f350 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efde00019f0 con 0x7efde813f350 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.393 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1328057882 0 0) 0x7efde8142940 con 0x7efde8138d40 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 >> v1:172.21.15.73:6792/0 conn(0x7efde813f350 legacy=0x7efde81d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 >> v1:172.21.15.203:6791/0 conn(0x7efde80a72f0 legacy=0x7efde813f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 monclient: found mon.a 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde80a53f0 con 0x7efde8138d40 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efdeedf8640 5 monclient: authenticate success, global_id 4176 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efdeedf8640 10 monclient: _renew_subs 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efdeedf8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:10.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efdeedf8640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efde8142130 con 0x7efde8138d40 2024-09-11T01:58:10.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efdeedf8640 10 monclient: _renew_subs 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efdeedf8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efdeedf8640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efde80a14a0 con 0x7efde8138d40 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdd8004a90 con 0x7efde8138d40 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efdd8004f80 con 0x7efde8138d40 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddd7fa640 10 monclient: dump: 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.370+0000 7efddeffd640 4 set_mon_vals no callback set 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.371+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7efdd80054b0 con 0x7efde8138d40 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.371+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 993168317 0 0) 0x7efdd8006d00 con 0x7efde8138d40 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.371+0000 7efdeedf8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.371+0000 7efdeedf8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.371+0000 7efdeedf8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.371+0000 7efdeedf8640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc8005080 con 0x7efde8138d40 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.373+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (unknown 1092875540 0 2798735707) 0x7efdd8006710 con 0x7efde8138d40 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.373+0000 7efddd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.373+0000 7efddd7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:10.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.432+0000 7efdeedf8640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:10.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.432+0000 7efdeedf8640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:10.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.432+0000 7efdeedf8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:10.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.432+0000 7efdeedf8640 1 -- 172.21.15.73:0/1333041339 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdc8005370 con 0x7efde8138d40 2024-09-11T01:58:10.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.432+0000 7efddd7fa640 1 -- 172.21.15.73:0/1333041339 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 4027581391) 0x7efdd8006970 con 0x7efde8138d40 2024-09-11T01:58:10.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.432+0000 7efddd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:10.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.432+0000 7efddd7fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:10.435 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:10.435 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","created":"2024-09-11T01:58:08.604820+0000","modified":"2024-09-11T01:58:10.229533+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T01:58:10.229533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0ed1d0ce-ed57-4eed-b684-5c04e84a8405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3aa077b3-74c6-4609-8587-8a3c5ec8bc4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"063c664b-ce58-42bd-bd80-0d6b9721fcb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"12d01ea7-7a0e-4b5a-ac25-a6ba6af66458","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b89af16-5602-4527-ba2c-b7142acac9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ae991c5c-eac0-4bd2-8d87-7efa36a62abb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:58:10.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.433+0000 7efdeedf8640 10 monclient: shutdown 2024-09-11T01:58:10.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.433+0000 7efdeedf8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:10.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.433+0000 7efdeedf8640 1 -- 172.21.15.73:0/1333041339 >> v1:172.21.15.73:6789/0 conn(0x7efde8138d40 legacy=0x7efde813fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:10.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.433+0000 7efdeedf8640 1 -- 172.21.15.73:0/1333041339 shutdown_connections 2024-09-11T01:58:10.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.433+0000 7efdeedf8640 1 -- 172.21.15.73:0/1333041339 >> 172.21.15.73:0/1333041339 conn(0x7efde80a8050 msgr2=0x7efde8131a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:10.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.433+0000 7efdeedf8640 1 -- 172.21.15.73:0/1333041339 shutdown_connections 2024-09-11T01:58:10.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:10.433+0000 7efdeedf8640 1 -- 172.21.15.73:0/1333041339 wait complete. 2024-09-11T01:58:10.445 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T01:58:10.446 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T01:58:11.051 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T01:58:11.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.147+0000 7ff600e79640 10 monclient: get_monmap_and_config 2024-09-11T01:58:11.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.147+0000 7ff600e79640 10 monclient: build_initial_monmap 2024-09-11T01:58:11.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.147+0000 7ff600e79640 10 monclient: monmap: 2024-09-11T01:58:11.149 INFO:teuthology.misc.health.smithi073.stderr:epoch 0 2024-09-11T01:58:11.149 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:11.149 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:58:11.148436+0000 2024-09-11T01:58:11.149 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:58:11.148436+0000 2024-09-11T01:58:11.149 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:11.149 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:11.150 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 1 Processor -- start 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 1 -- start start 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 10 monclient: init 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 10 monclient: _add_conns ranks=[2,7,4,3,8,6,0,5,1] 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 10 monclient(hunting): picked mon.noname-b con 0x7ff5fc0a4e00 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 10 monclient(hunting): picked mon.noname-i con 0x7ff5fc0a6d60 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 10 monclient(hunting): picked mon.noname-c con 0x7ff5fc0a7140 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc0a48e0 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc0a8240 con 0x7ff5fc0a7140 2024-09-11T01:58:11.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc0a3960 con 0x7ff5fc0a6d60 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff600e79640 10 monclient(hunting): authenticate will time out at 732.752700s 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff5fa59c640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7ff5fc0a4e00 0x7ff5fc0a6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:36590/0 (socket says 172.21.15.73:36590) 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff5fad9d640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7ff5fc0a7140 0x7ff5fc141d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:44240/0 (socket says 172.21.15.73:44240) 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.148+0000 7ff5fa59c640 1 -- 172.21.15.73:0/4148359827 learned_addr learned my addr 172.21.15.73:0/4148359827 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3373840233 0 0) 0x7ff5fc0a8240 con 0x7ff5fc0a7140 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): _negotiate 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): my global_id is 4216 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e8003520 con 0x7ff5fc0a7140 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4218158628 0 0) 0x7ff5fc0a48e0 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): _negotiate 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): my global_id is 4178 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5fc0a8240 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332844096 0 0) 0x7ff5fc0a3960 con 0x7ff5fc0a6d60 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): _negotiate 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient(hunting): my global_id is 4156 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5fc0a48e0 con 0x7ff5fc0a6d60 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 693750284 0 0) 0x7ff5e8003520 con 0x7ff5fc0a7140 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 >> v1:172.21.15.203:6792/0 conn(0x7ff5fc0a6d60 legacy=0x7ff5fc13e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:11.160 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 >> v1:172.21.15.73:6790/0 conn(0x7ff5fc0a4e00 legacy=0x7ff5fc0a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: _finish_hunting 0 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 monclient: found mon.noname-c 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc0a4040 con 0x7ff5fc0a7140 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: _finish_auth 0 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: _check_auth_tickets 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff5f4001bb0 con 0x7ff5fc0a7140 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 5 monclient: authenticate success, global_id 4216 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:11.161 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: dump: 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:11.162 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5f4001dd0 con 0x7ff5fc0a7140 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 1 -- 172.21.15.73:0/4148359827 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff5f4004ea0 con 0x7ff5fc0a7140 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 4 set_mon_vals no callback set 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:11.163 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff5f9d9b640 10 monclient: dump: 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:11.164 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 10 monclient: shutdown 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 1 -- 172.21.15.73:0/4148359827 >> v1:172.21.15.73:6791/0 conn(0x7ff5fc0a7140 legacy=0x7ff5fc141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 1 -- 172.21.15.73:0/4148359827 shutdown_connections 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.149+0000 7ff600e79640 1 -- 172.21.15.73:0/4148359827 >> 172.21.15.73:0/4148359827 conn(0x7ff5fc0abc50 msgr2=0x7ff5fc0ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.150+0000 7ff600e79640 1 -- 172.21.15.73:0/4148359827 shutdown_connections 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.150+0000 7ff600e79640 1 -- 172.21.15.73:0/4148359827 wait complete. 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.150+0000 7ff600e79640 10 monclient: build_initial_monmap 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.150+0000 7ff600e79640 10 monclient: monmap: 2024-09-11T01:58:11.165 INFO:teuthology.misc.health.smithi073.stderr:epoch 0 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:created 0.000000 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:11.166 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 1 Processor -- start 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 1 -- start start 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 10 monclient: init 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 10 monclient: _add_conns ranks=[6,0,1,8,5,4,3,2,7] 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 10 monclient(hunting): picked mon.noname-d con 0x7ff5fc0a4e00 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 10 monclient(hunting): picked mon.noname-a con 0x7ff5fc0a6d60 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 10 monclient(hunting): picked mon.noname-f con 0x7ff5fc0a7140 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc0a8e20 con 0x7ff5fc0a6d60 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc1393d0 con 0x7ff5fc0a7140 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc13ae90 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff600e79640 10 monclient(hunting): authenticate will time out at 732.755730s 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff5f1d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff5fc0a6d60 0x7ff5fc1d2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52618/0 (socket says 172.21.15.73:52618) 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff5fa59c640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7ff5fc0a4e00 0x7ff5fc141cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:49050/0 (socket says 172.21.15.73:49050) 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.151+0000 7ff5f1d9b640 1 -- 172.21.15.73:0/3471245670 learned_addr learned my addr 172.21.15.73:0/3471245670 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080131749 0 0) 0x7ff5fc13ae90 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): my global_id is 4155 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5dc003550 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546064360 0 0) 0x7ff5fc0a8e20 con 0x7ff5fc0a6d60 2024-09-11T01:58:11.168 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): my global_id is 4185 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5fc13ae90 con 0x7ff5fc0a6d60 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326787526 0 0) 0x7ff5fc1393d0 con 0x7ff5fc0a7140 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): my global_id is 4177 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5fc0a8e20 con 0x7ff5fc0a7140 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2437674378 0 0) 0x7ff5dc003550 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5fc1393d0 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.169 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 793909962 0 0) 0x7ff5fc13ae90 con 0x7ff5fc0a6d60 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5dc003550 con 0x7ff5fc0a6d60 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff5ec001900 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): dump: 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:11.170 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff5e4001a90 con 0x7ff5fc0a6d60 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): dump: 2024-09-11T01:58:11.171 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:11.172 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1398084273 0 0) 0x7ff5fc0a8e20 con 0x7ff5fc0a7140 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5fc13ae90 con 0x7ff5fc0a7140 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff5f4001b70 con 0x7ff5fc0a7140 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient(hunting): dump: 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:11.173 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3970414955 0 0) 0x7ff5fc1393d0 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 >> v1:172.21.15.203:6789/0 conn(0x7ff5fc0a7140 legacy=0x7ff5fc1d6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:11.174 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 >> v1:172.21.15.73:6789/0 conn(0x7ff5fc0a6d60 legacy=0x7ff5fc1d2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 monclient: found mon.d 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc13b170 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff600e79640 5 monclient: authenticate success, global_id 4155 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff600e79640 10 monclient: _renew_subs 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff600e79640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff600e79640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc1ca660 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff600e79640 10 monclient: _renew_subs 2024-09-11T01:58:11.175 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff600e79640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff600e79640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5fc139f30 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5ec001aa0 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff5ec001cc0 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f959a640 4 set_mon_vals no callback set 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 10 monclient: dump: 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:11.176 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 1) ==== 811+0+0 (unknown 4133961934 0 0) 0x7ff5ec0051a0 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.152+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 993168317 0 0) 0x7ff5ec006b10 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.177 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.153+0000 7ff600e79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:11.178 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.153+0000 7ff600e79640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:11.178 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.153+0000 7ff600e79640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:11.178 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.153+0000 7ff600e79640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e0005080 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.178 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.155+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+76091 (unknown 1092875540 0 2798735707) 0x7ff5ec006500 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.178 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.155+0000 7ff5f37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:11.178 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.155+0000 7ff5f37fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:11.218 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.216+0000 7ff600e79640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:11.218 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.216+0000 7ff600e79640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:11.218 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.216+0000 7ff600e79640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:11.218 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.216+0000 7ff600e79640 1 -- 172.21.15.73:0/3471245670 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5e0005370 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.219 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.217+0000 7ff5f37fe640 1 -- 172.21.15.73:0/3471245670 <== mon.6 v1:172.21.15.73:6792/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 4027581391) 0x7ff5ec006790 con 0x7ff5fc0a4e00 2024-09-11T01:58:11.219 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.217+0000 7ff5f37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:11.219 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.217+0000 7ff5f37fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:11.219 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-11T01:58:11.219 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":8,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","created":"2024-09-11T01:58:08.604820+0000","modified":"2024-09-11T01:58:10.229533+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T01:58:10.229533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0ed1d0ce-ed57-4eed-b684-5c04e84a8405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3aa077b3-74c6-4609-8587-8a3c5ec8bc4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"063c664b-ce58-42bd-bd80-0d6b9721fcb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"12d01ea7-7a0e-4b5a-ac25-a6ba6af66458","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b89af16-5602-4527-ba2c-b7142acac9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ae991c5c-eac0-4bd2-8d87-7efa36a62abb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:58:11.220 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.217+0000 7ff600e79640 10 monclient: shutdown 2024-09-11T01:58:11.220 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.217+0000 7ff600e79640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:11.220 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.217+0000 7ff600e79640 1 -- 172.21.15.73:0/3471245670 >> v1:172.21.15.73:6792/0 conn(0x7ff5fc0a4e00 legacy=0x7ff5fc141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:11.220 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.218+0000 7ff600e79640 1 -- 172.21.15.73:0/3471245670 shutdown_connections 2024-09-11T01:58:11.220 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.218+0000 7ff600e79640 1 -- 172.21.15.73:0/3471245670 >> 172.21.15.73:0/3471245670 conn(0x7ff5fc0abc50 msgr2=0x7ff5fc0ab200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:11.220 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.218+0000 7ff600e79640 1 -- 172.21.15.73:0/3471245670 shutdown_connections 2024-09-11T01:58:11.220 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:11.218+0000 7ff600e79640 1 -- 172.21.15.73:0/3471245670 wait complete. 2024-09-11T01:58:11.228 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-11T01:58:11.695 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-09-11T01:58:11.693+0000 7fd8f2c15640 -1 Falling back to public interface 2024-09-11T01:58:11.716 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-11T01:58:11.714+0000 7ff4ca816640 -1 Falling back to public interface 2024-09-11T01:58:11.936 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-11T01:58:11.934+0000 7f292f818640 -1 Falling back to public interface 2024-09-11T01:58:11.953 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-11T01:58:11.951+0000 7ff39de2c640 -1 Falling back to public interface 2024-09-11T01:58:11.961 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-09-11T01:58:11.959+0000 7f378c00f640 -1 Falling back to public interface 2024-09-11T01:58:12.202 INFO:tasks.ceph.osd.3.smithi203.stderr:2024-09-11T01:58:12.200+0000 7f3412bdb640 -1 Falling back to public interface 2024-09-11T01:58:13.892 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-09-11T01:58:13.889+0000 7f0ea3fbd640 -1 mgr.server handle_report got status from non-daemon mon.e 2024-09-11T01:58:13.892 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-09-11T01:58:13.890+0000 7f0ea3fbd640 -1 mgr.server handle_report got status from non-daemon mon.f 2024-09-11T01:58:13.892 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-09-11T01:58:13.890+0000 7f0ea3fbd640 -1 mgr.server handle_report got status from non-daemon mon.h 2024-09-11T01:58:13.892 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-09-11T01:58:13.890+0000 7f0ea3fbd640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T01:58:13.892 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-09-11T01:58:13.890+0000 7f0ea3fbd640 -1 mgr.server handle_report got status from non-daemon mon.g 2024-09-11T01:58:13.892 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-09-11T01:58:13.890+0000 7f0ea3fbd640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T01:58:13.893 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-09-11T01:58:13.890+0000 7f0ea3fbd640 -1 mgr.server handle_report got status from non-daemon mon.i 2024-09-11T01:58:13.893 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-09-11T01:58:13.891+0000 7f0ea3fbd640 -1 mgr.server handle_report got status from non-daemon mon.d 2024-09-11T01:58:15.246 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-11T01:58:15.244+0000 7ff4ca816640 -1 osd.1 0 log_to_monitors true 2024-09-11T01:58:15.442 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-11T01:58:15.441+0000 7f292f818640 -1 osd.0 0 log_to_monitors true 2024-09-11T01:58:15.522 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-09-11T01:58:15.520+0000 7fd8f2c15640 -1 osd.5 0 log_to_monitors true 2024-09-11T01:58:15.727 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-11T01:58:15.725+0000 7ff39de2c640 -1 osd.2 0 log_to_monitors true 2024-09-11T01:58:15.783 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-09-11T01:58:15.782+0000 7f378c00f640 -1 osd.4 0 log_to_monitors true 2024-09-11T01:58:15.961 INFO:tasks.ceph.osd.3.smithi203.stderr:2024-09-11T01:58:15.959+0000 7f3412bdb640 -1 osd.3 0 log_to_monitors true 2024-09-11T01:58:16.916 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-11T01:58:16.914+0000 7ff4c609f640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T01:58:16.919 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-11T01:58:16.917+0000 7ff4c1ec6640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:58:17.834 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T01:58:17.908 INFO:tasks.ceph.osd.3.smithi203.stderr:2024-09-11T01:58:17.906+0000 7f340eb6a640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T01:58:17.914 INFO:tasks.ceph.osd.3.smithi203.stderr:2024-09-11T01:58:17.912+0000 7f340a991640 -1 osd.3 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:58:17.934 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.933+0000 7f6c637b4640 10 monclient: get_monmap_and_config 2024-09-11T01:58:17.934 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.933+0000 7f6c637b4640 10 monclient: build_initial_monmap 2024-09-11T01:58:17.934 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.933+0000 7f6c637b4640 10 monclient: monmap: 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:epoch 0 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:58:17.934059+0000 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:58:17.934059+0000 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:17.935 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:17.936 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:17.936 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:17.936 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:17.943 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.933+0000 7f6c637b4640 1 Processor -- start 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.933+0000 7f6c637b4640 1 -- start start 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.933+0000 7f6c637b4640 10 monclient: init 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 10 monclient: _add_conns ranks=[5,2,1,6,3,4,0,7,8] 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 10 monclient(hunting): picked mon.noname-h con 0x7f6c5c0a5870 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 10 monclient(hunting): picked mon.noname-b con 0x7f6c5c09d050 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 10 monclient(hunting): picked mon.noname-f con 0x7f6c5c0a5c50 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5c09dad0 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5c136870 con 0x7f6c5c09d050 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5c0a6080 con 0x7f6c5c0a5870 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c637b4640 10 monclient(hunting): authenticate will time out at 739.538526s 2024-09-11T01:58:17.944 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c60d4f640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f6c5c09d050 0x7f6c5c136160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:56968/0 (socket says 172.21.15.73:56968) 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c60d4f640 1 -- 172.21.15.73:0/1612048541 learned_addr learned my addr 172.21.15.73:0/1612048541 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373362485 0 0) 0x7f6c5c136870 con 0x7f6c5c09d050 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 10 monclient(hunting): my global_id is 4214 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c48003520 con 0x7f6c5c09d050 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314962384 0 0) 0x7f6c5c0a6080 con 0x7f6c5c0a5870 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.934+0000 7f6c53fff640 10 monclient(hunting): my global_id is 4217 2024-09-11T01:58:17.945 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c5c136870 con 0x7f6c5c0a5870 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950536878 0 0) 0x7f6c5c09dad0 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient(hunting): my global_id is 4186 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c5c0a6080 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1386710091 0 0) 0x7f6c48003520 con 0x7f6c5c09d050 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 >> v1:172.21.15.203:6791/0 conn(0x7f6c5c0a5870 legacy=0x7f6c5c135a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 >> v1:172.21.15.203:6789/0 conn(0x7f6c5c0a5c50 legacy=0x7f6c5c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 monclient: found mon.noname-b 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:17.946 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c09dd40 con 0x7f6c5c09d050 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: _finish_auth 0 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c4c001830 con 0x7f6c5c09d050 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: dump: 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:17.947 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 5 monclient: authenticate success, global_id 4214 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:17.948 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c4c0019d0 con 0x7f6c5c09d050 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 4 set_mon_vals no callback set 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 1 -- 172.21.15.73:0/1612048541 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c4c004be0 con 0x7f6c5c09d050 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c53fff640 10 monclient: dump: 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:17.949 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 10 monclient: shutdown 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 1 -- 172.21.15.73:0/1612048541 >> v1:172.21.15.73:6790/0 conn(0x7f6c5c09d050 legacy=0x7f6c5c136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 1 -- 172.21.15.73:0/1612048541 shutdown_connections 2024-09-11T01:58:17.950 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 1 -- 172.21.15.73:0/1612048541 >> 172.21.15.73:0/1612048541 conn(0x7f6c5c06dc10 msgr2=0x7f6c5c0abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 1 -- 172.21.15.73:0/1612048541 shutdown_connections 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.935+0000 7f6c637b4640 1 -- 172.21.15.73:0/1612048541 wait complete. 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.936+0000 7f6c637b4640 10 monclient: build_initial_monmap 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.936+0000 7f6c637b4640 10 monclient: monmap: 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:epoch 0 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:created 0.000000 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:17.951 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 1 Processor -- start 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 1 -- start start 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 10 monclient: init 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 10 monclient: _add_conns ranks=[8,3,0,1,7,5,2,6,4] 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 10 monclient(hunting): picked mon.noname-e con 0x7f6c5c09d050 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:17.952 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 10 monclient(hunting): picked mon.noname-g con 0x7f6c5c0a5870 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 10 monclient(hunting): picked mon.noname-a con 0x7f6c5c0a5c50 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5c132dc0 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.937+0000 7f6c637b4640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5c123b00 con 0x7f6c5c0a5870 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c61550640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f6c5c09d050 0x7f6c5c0a3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:34256/0 (socket says 172.21.15.73:34256) 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c61550640 1 -- 172.21.15.73:0/1216086892 learned_addr learned my addr 172.21.15.73:0/1216086892 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c637b4640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5c123de0 con 0x7f6c5c09d050 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c637b4640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c637b4640 10 monclient(hunting): authenticate will time out at 739.542119s 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2151563211 0 0) 0x7f6c5c132dc0 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:17.953 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): my global_id is 4239 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c40003520 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383647261 0 0) 0x7f6c5c123de0 con 0x7f6c5c09d050 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): my global_id is 4193 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c5c132dc0 con 0x7f6c5c09d050 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497928115 0 0) 0x7f6c5c123b00 con 0x7f6c5c0a5870 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): my global_id is 4224 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c5c123de0 con 0x7f6c5c0a5870 2024-09-11T01:58:17.954 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1392171954 0 0) 0x7f6c40003520 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c5c123b00 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c54001d70 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): dump: 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:17.955 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1977542428 0 0) 0x7f6c5c123de0 con 0x7f6c5c0a5870 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c40003520 con 0x7f6c5c0a5870 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3762092431 0 0) 0x7f6c5c132dc0 con 0x7f6c5c09d050 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c5c123de0 con 0x7f6c5c09d050 2024-09-11T01:58:17.956 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c4c004b20 con 0x7f6c5c0a5870 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): dump: 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:17.957 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c58001b50 con 0x7f6c5c09d050 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient(hunting): dump: 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.958 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3241043534 0 0) 0x7f6c5c123b00 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 >> v1:172.21.15.73:6793/0 conn(0x7f6c5c09d050 legacy=0x7f6c5c0a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:17.959 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 >> v1:172.21.15.203:6790/0 conn(0x7f6c5c0a5870 legacy=0x7f6c5c0a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient: _finish_hunting 0 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 monclient: found mon.a 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c135d80 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient: _finish_auth 0 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 10 monclient: _check_auth_tickets 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c51ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c637b4640 5 monclient: authenticate success, global_id 4239 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c637b4640 10 monclient: _renew_subs 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c637b4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:17.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.938+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5c135950 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c54002010 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c51ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c54004040 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c51ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c51ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c51ffb640 10 monclient: dump: 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:17.961 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c637b4640 10 monclient: _renew_subs 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c637b4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c537fe640 4 set_mon_vals no callback set 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.939+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c5c123820 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.940+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 4) ==== 50522+0+0 (unknown 737812994 0 0) 0x7f6c540041e0 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.962 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.940+0000 7f6c637b4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:17.963 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.940+0000 7f6c637b4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:17.963 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.940+0000 7f6c637b4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:17.963 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.940+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c5c09c9e0 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.963 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.940+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(11..11 src has 1..11) ==== 2067+0+0 (unknown 4072277076 0 0) 0x7f6c5404cb80 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.963 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.940+0000 7f6c61550640 10 monclient: get_auth_request con 0x7f6c400406b0 auth_method 0 2024-09-11T01:58:17.963 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.945+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f6c54015f50 con 0x7f6c5c0a5c50 2024-09-11T01:58:17.964 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.945+0000 7f6c51ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:17.964 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:17.945+0000 7f6c51ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:18.141 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.139+0000 7f6c637b4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:18.141 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.139+0000 7f6c637b4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:18.141 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.139+0000 7f6c637b4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:18.141 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.139+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c5c09fdf0 con 0x7f6c5c0a5c50 2024-09-11T01:58:18.141 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.139+0000 7f6c51ffb640 1 -- 172.21.15.73:0/1216086892 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+5863 (unknown 238102980 0 2534497834) 0x7f6c5401bdd0 con 0x7f6c5c0a5c50 2024-09-11T01:58:18.141 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.139+0000 7f6c51ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:18.141 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.139+0000 7f6c51ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:18.142 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-11T01:58:18.142 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":11,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","created":"2024-09-11T01:58:08.604820+0000","modified":"2024-09-11T01:58:17.899924+0000","last_up_change":"2024-09-11T01:58:17.899924+0000","last_in_change":"2024-09-11T01:58:10.229533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0ed1d0ce-ed57-4eed-b684-5c04e84a8405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3aa077b3-74c6-4609-8587-8a3c5ec8bc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":2131770571}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":2131770571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":2131770571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":2131770571}]},"public_addr":"172.21.15.73:6800/2131770571","cluster_addr":"172.21.15.73:6801/2131770571","heartbeat_back_addr":"172.21.15.73:6803/2131770571","heartbeat_front_addr":"172.21.15.73:6802/2131770571","state":["exists","up"]},{"osd":2,"uuid":"063c664b-ce58-42bd-bd80-0d6b9721fcb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"12d01ea7-7a0e-4b5a-ac25-a6ba6af66458","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b89af16-5602-4527-ba2c-b7142acac9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ae991c5c-eac0-4bd2-8d87-7efa36a62abb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:58:18.143 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.142+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 >> v1:172.21.15.203:6812/2311533528 conn(0x7f6c400406b0 legacy=0x7f6c40042b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:18.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.142+0000 7f6c637b4640 10 monclient: shutdown 2024-09-11T01:58:18.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.142+0000 7f6c637b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:18.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.142+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 >> v1:172.21.15.73:6789/0 conn(0x7f6c5c0a5c50 legacy=0x7f6c5c1d6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:18.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.142+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 shutdown_connections 2024-09-11T01:58:18.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.142+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 >> 172.21.15.73:0/1216086892 conn(0x7f6c5c06dc10 msgr2=0x7f6c5c137ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:18.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.142+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 shutdown_connections 2024-09-11T01:58:18.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:18.142+0000 7f6c637b4640 1 -- 172.21.15.73:0/1216086892 wait complete. 2024-09-11T01:58:18.152 DEBUG:teuthology.misc:1 of 6 OSDs are up 2024-09-11T01:58:19.751 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-11T01:58:19.749+0000 7ff399dbb640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T01:58:19.751 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-09-11T01:58:19.749+0000 7fd8ee526640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T01:58:19.756 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-09-11T01:58:19.754+0000 7fd8e6345640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:58:19.759 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-11T01:58:19.757+0000 7ff391bda640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:58:19.760 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-09-11T01:58:19.758+0000 7f378791e640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T01:58:19.763 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-11T01:58:19.761+0000 7f292ba67640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T01:58:19.763 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-09-11T01:58:19.762+0000 7f377f73d640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:58:19.767 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-11T01:58:19.765+0000 7f2923072640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:58:24.757 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T01:58:24.857 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.855+0000 7f9be4e6e640 10 monclient: get_monmap_and_config 2024-09-11T01:58:24.857 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.855+0000 7f9be4e6e640 10 monclient: build_initial_monmap 2024-09-11T01:58:24.858 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.855+0000 7f9be4e6e640 10 monclient: monmap: 2024-09-11T01:58:24.858 INFO:teuthology.misc.health.smithi073.stderr:epoch 0 2024-09-11T01:58:24.858 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:24.858 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:58:24.856041+0000 2024-09-11T01:58:24.858 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:58:24.856041+0000 2024-09-11T01:58:24.859 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:24.859 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:24.859 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:24.859 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:24.859 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:24.859 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:24.859 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:24.860 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:24.860 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:24.860 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:24.860 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:24.860 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:24.860 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.855+0000 7f9be4e6e640 1 Processor -- start 2024-09-11T01:58:24.861 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.855+0000 7f9be4e6e640 1 -- start start 2024-09-11T01:58:24.861 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.855+0000 7f9be4e6e640 10 monclient: init 2024-09-11T01:58:24.871 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:24.871 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 10 monclient: _add_conns ranks=[2,0,5,8,1,6,4,3,7] 2024-09-11T01:58:24.871 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 10 monclient(hunting): picked mon.noname-b con 0x7f9be00a5870 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:24.871 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 10 monclient(hunting): picked mon.noname-a con 0x7f9be009d050 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:24.871 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 10 monclient(hunting): picked mon.noname-h con 0x7f9be00a5c50 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be009dad0 con 0x7f9be009d050 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be0136870 con 0x7f9be00a5870 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be00a6080 con 0x7f9be00a5c50 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9be4e6e640 10 monclient(hunting): authenticate will time out at 746.460618s 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9bde59c640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f9be00a5870 0x7f9be0135a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41000/0 (socket says 172.21.15.73:41000) 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9bde59c640 1 -- 172.21.15.73:0/1196682785 learned_addr learned my addr 172.21.15.73:0/1196682785 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.856+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315380986 0 0) 0x7f9be009dad0 con 0x7f9be009d050 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient(hunting): my global_id is 4266 2024-09-11T01:58:24.872 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bcc003520 con 0x7f9be009d050 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023292988 0 0) 0x7f9be0136870 con 0x7f9be00a5870 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient(hunting): my global_id is 4232 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be009dad0 con 0x7f9be00a5870 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 541297702 0 0) 0x7f9bcc003520 con 0x7f9be009d050 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 >> v1:172.21.15.203:6791/0 conn(0x7f9be00a5c50 legacy=0x7f9be0142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 >> v1:172.21.15.73:6790/0 conn(0x7f9be00a5870 legacy=0x7f9be0135a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: _finish_hunting 0 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 monclient: found mon.noname-a 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:24.873 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be009dd40 con 0x7f9be009d050 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: _finish_auth 0 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: _check_auth_tickets 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9bd0001830 con 0x7f9be009d050 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9be4e6e640 5 monclient: authenticate success, global_id 4266 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9be4e6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: dump: 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:24.874 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9be4e6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bd0001a50 con 0x7f9be009d050 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9be4e6e640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:24.875 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 1 -- 172.21.15.73:0/1196682785 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9bd0003950 con 0x7f9be009d050 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9be4e6e640 4 set_mon_vals no callback set 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9bdd59a640 10 monclient: dump: 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:24.876 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9be4e6e640 10 monclient: shutdown 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9be4e6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.857+0000 7f9be4e6e640 1 -- 172.21.15.73:0/1196682785 >> v1:172.21.15.73:6789/0 conn(0x7f9be009d050 legacy=0x7f9be0136160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.858+0000 7f9be4e6e640 1 -- 172.21.15.73:0/1196682785 shutdown_connections 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.858+0000 7f9be4e6e640 1 -- 172.21.15.73:0/1196682785 >> 172.21.15.73:0/1196682785 conn(0x7f9be006dc10 msgr2=0x7f9be00abbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.858+0000 7f9be4e6e640 1 -- 172.21.15.73:0/1196682785 shutdown_connections 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.858+0000 7f9be4e6e640 1 -- 172.21.15.73:0/1196682785 wait complete. 2024-09-11T01:58:24.877 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.858+0000 7f9be4e6e640 10 monclient: build_initial_monmap 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.858+0000 7f9be4e6e640 10 monclient: monmap: 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:epoch 0 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:created 0.000000 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:24.878 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 1 Processor -- start 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 1 -- start start 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 10 monclient: init 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 10 monclient: _add_conns ranks=[3,1,5,6,0,2,8,7,4] 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 10 monclient(hunting): picked mon.noname-g con 0x7f9be009d050 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:24.879 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 10 monclient(hunting): picked mon.noname-f con 0x7f9be00a5870 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 10 monclient(hunting): picked mon.noname-h con 0x7f9be00a5c50 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be00a32e0 con 0x7f9be00a5870 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be01cebb0 con 0x7f9be009d050 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be00ab3b0 con 0x7f9be00a5c50 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9be4e6e640 10 monclient(hunting): authenticate will time out at 746.463867s 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9bde59c640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7f9be009d050 0x7f9be01cdd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.73:41152/0 (socket says 172.21.15.73:41152) 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.859+0000 7f9bde59c640 1 -- 172.21.15.73:0/3633934876 learned_addr learned my addr 172.21.15.73:0/3633934876 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559315419 0 0) 0x7f9be01cebb0 con 0x7f9be009d050 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:24.880 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): my global_id is 4260 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bc0003520 con 0x7f9be009d050 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152599720 0 0) 0x7f9be00a32e0 con 0x7f9be00a5870 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): my global_id is 4204 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be01cebb0 con 0x7f9be00a5870 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251957641 0 0) 0x7f9be00ab3b0 con 0x7f9be00a5c50 2024-09-11T01:58:24.881 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): my global_id is 4253 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be00a32e0 con 0x7f9be00a5c50 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3407027761 0 0) 0x7f9be01cebb0 con 0x7f9be00a5870 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9be00ab3b0 con 0x7f9be00a5870 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3345548281 0 0) 0x7f9bc0003520 con 0x7f9be009d050 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9be01cebb0 con 0x7f9be009d050 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9bd00017f0 con 0x7f9be00a5870 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:24.882 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:24.883 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9bc8001520 con 0x7f9be009d050 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:24.884 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:24.885 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4238974796 0 0) 0x7f9be00a32e0 con 0x7f9be00a5c50 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bc0003520 con 0x7f9be00a5c50 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9bd8001c00 con 0x7f9be00a5c50 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:24.886 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:24.887 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3281623829 0 0) 0x7f9be00ab3b0 con 0x7f9be00a5870 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 >> v1:172.21.15.203:6791/0 conn(0x7f9be00a5c50 legacy=0x7f9be01d6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 >> v1:172.21.15.203:6790/0 conn(0x7f9be009d050 legacy=0x7f9be01cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 monclient: found mon.f 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be00aae60 con 0x7f9be00a5870 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:24.888 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9bd6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9be4e6e640 5 monclient: authenticate success, global_id 4204 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9be4e6e640 10 monclient: _renew_subs 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9be4e6e640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9be00a1ae0 con 0x7f9be00a5870 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9be4e6e640 10 monclient: _renew_subs 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9be4e6e640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.860+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9be00a5540 con 0x7f9be00a5870 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.861+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bd0001990 con 0x7f9be00a5870 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.861+0000 7f9bd6ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.861+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9bd0003c10 con 0x7f9be00a5870 2024-09-11T01:58:24.889 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.861+0000 7f9bd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.861+0000 7f9bdcd99640 4 set_mon_vals no callback set 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.861+0000 7f9bd6ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.861+0000 7f9bd6ffd640 10 monclient: dump: 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:epoch 1 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:24.890 INFO:teuthology.misc.health.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr: 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.861+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9bd0010350 con 0x7f9be00a5870 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.862+0000 7f9be4e6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.862+0000 7f9be4e6e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.862+0000 7f9be4e6e640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.862+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc4005080 con 0x7f9be00a5870 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.862+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 8 ==== osd_map(16..16 src has 1..16) ==== 3153+0+0 (unknown 3523531802 0 0) 0x7f9bd004cf00 con 0x7f9be00a5870 2024-09-11T01:58:24.891 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.862+0000 7f9bde59c640 10 monclient: get_auth_request con 0x7f9bc00406e0 auth_method 0 2024-09-11T01:58:24.892 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.867+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f9bd00163a0 con 0x7f9be00a5870 2024-09-11T01:58:24.892 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.867+0000 7f9bd6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:24.892 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:24.867+0000 7f9bd6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:25.047 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.045+0000 7f9be4e6e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:25.047 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.045+0000 7f9be4e6e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:25.047 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.045+0000 7f9be4e6e640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:25.047 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.045+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 --> v1:172.21.15.203:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9bc4005370 con 0x7f9be00a5870 2024-09-11T01:58:25.048 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.046+0000 7f9bd6ffd640 1 -- 172.21.15.73:0/3633934876 <== mon.1 v1:172.21.15.203:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9049 (unknown 1054498076 0 3431057697) 0x7f9bd0015ca0 con 0x7f9be00a5870 2024-09-11T01:58:25.048 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.046+0000 7f9bd6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:25.048 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.046+0000 7f9bd6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:25.048 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-11T01:58:25.048 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":16,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","created":"2024-09-11T01:58:08.604820+0000","modified":"2024-09-11T01:58:22.954373+0000","last_up_change":"2024-09-11T01:58:19.924468+0000","last_in_change":"2024-09-11T01:58:10.229533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:58:20.893945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ed1d0ce-ed57-4eed-b684-5c04e84a8405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":3691603832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":3691603832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":3691603832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":3691603832}]},"public_addr":"172.21.15.73:6804/3691603832","cluster_addr":"172.21.15.73:6805/3691603832","heartbeat_back_addr":"172.21.15.73:6807/3691603832","heartbeat_front_addr":"172.21.15.73:6806/3691603832","state":["exists","up"]},{"osd":1,"uuid":"3aa077b3-74c6-4609-8587-8a3c5ec8bc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":2131770571}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":2131770571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":2131770571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":2131770571}]},"public_addr":"172.21.15.73:6800/2131770571","cluster_addr":"172.21.15.73:6801/2131770571","heartbeat_back_addr":"172.21.15.73:6803/2131770571","heartbeat_front_addr":"172.21.15.73:6802/2131770571","state":["exists","up"]},{"osd":2,"uuid":"063c664b-ce58-42bd-bd80-0d6b9721fcb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":2154209098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":2154209098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":2154209098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":2154209098}]},"public_addr":"172.21.15.73:6808/2154209098","cluster_addr":"172.21.15.73:6809/2154209098","heartbeat_back_addr":"172.21.15.73:6811/2154209098","heartbeat_front_addr":"172.21.15.73:6810/2154209098","state":["exists","up"]},{"osd":3,"uuid":"12d01ea7-7a0e-4b5a-ac25-a6ba6af66458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6808","nonce":1861196202}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6809","nonce":1861196202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6811","nonce":1861196202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6810","nonce":1861196202}]},"public_addr":"172.21.15.203:6808/1861196202","cluster_addr":"172.21.15.203:6809/1861196202","heartbeat_back_addr":"172.21.15.203:6811/1861196202","heartbeat_front_addr":"172.21.15.203:6810/1861196202","state":["exists","up"]},{"osd":4,"uuid":"8b89af16-5602-4527-ba2c-b7142acac9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6804","nonce":1562443458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6805","nonce":1562443458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6807","nonce":1562443458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6806","nonce":1562443458}]},"public_addr":"172.21.15.203:6804/1562443458","cluster_addr":"172.21.15.203:6805/1562443458","heartbeat_back_addr":"172.21.15.203:6807/1562443458","heartbeat_front_addr":"172.21.15.203:6806/1562443458","state":["exists","up"]},{"osd":5,"uuid":"ae991c5c-eac0-4bd2-8d87-7efa36a62abb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6800","nonce":464336651}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6801","nonce":464336651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6803","nonce":464336651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6802","nonce":464336651}]},"public_addr":"172.21.15.203:6800/464336651","cluster_addr":"172.21.15.203:6801/464336651","heartbeat_back_addr":"172.21.15.203:6803/464336651","heartbeat_front_addr":"172.21.15.203:6802/464336651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.395799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.286329+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.691165+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.965210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.767253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.540222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:58:25.051 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.049+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9bc00406e0 legacy=0x7f9bc0042ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:25.051 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.049+0000 7f9be4e6e640 10 monclient: shutdown 2024-09-11T01:58:25.051 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.049+0000 7f9be4e6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:25.051 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.049+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 >> v1:172.21.15.203:6789/0 conn(0x7f9be00a5870 legacy=0x7f9be01ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:25.051 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.049+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 shutdown_connections 2024-09-11T01:58:25.051 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.049+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 >> 172.21.15.73:0/3633934876 conn(0x7f9be006dc10 msgr2=0x7f9be0135940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:25.051 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.049+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 shutdown_connections 2024-09-11T01:58:25.051 INFO:teuthology.misc.health.smithi073.stderr:2024-09-11T01:58:25.049+0000 7f9be4e6e640 1 -- 172.21.15.73:0/3633934876 wait complete. 2024-09-11T01:58:25.060 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-11T01:58:25.060 INFO:tasks.ceph:Creating RBD pool 2024-09-11T01:58:25.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T01:58:25.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.155+0000 7f9061cc6640 10 monclient: get_monmap_and_config 2024-09-11T01:58:25.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.155+0000 7f9061cc6640 10 monclient: build_initial_monmap 2024-09-11T01:58:25.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.155+0000 7f9061cc6640 10 monclient: monmap: 2024-09-11T01:58:25.169 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:25.169 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:25.170 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:25.155889+0000 2024-09-11T01:58:25.170 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:25.155889+0000 2024-09-11T01:58:25.170 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:25.170 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:25.170 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:25.170 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:25.171 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:25.171 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:25.171 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:25.171 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:25.171 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:25.172 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:25.172 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:25.172 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:25.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.155+0000 7f9061cc6640 1 Processor -- start 2024-09-11T01:58:25.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.155+0000 7f9061cc6640 1 -- start start 2024-09-11T01:58:25.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.155+0000 7f9061cc6640 10 monclient: init 2024-09-11T01:58:25.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:25.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 10 monclient: _add_conns ranks=[0,1,7,8,6,5,3,2,4] 2024-09-11T01:58:25.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 10 monclient(hunting): picked mon.noname-a con 0x7f905c138d40 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:25.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 10 monclient(hunting): picked mon.noname-f con 0x7f905c0a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:25.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 10 monclient(hunting): picked mon.noname-i con 0x7f905c13f350 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:25.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c09ca00 con 0x7f905c138d40 2024-09-11T01:58:25.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c0a7070 con 0x7f905c0a72f0 2024-09-11T01:58:25.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c09cee0 con 0x7f905c13f350 2024-09-11T01:58:25.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:25.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 10 monclient(hunting): authenticate will time out at 746.760292s 2024-09-11T01:58:25.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f905c138d40 0x7f905c139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39786/0 (socket says 172.21.15.73:39786) 2024-09-11T01:58:25.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905b7fe640 1 -- 172.21.15.73:0/4115750369 learned_addr learned my addr 172.21.15.73:0/4115750369 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:25.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 -- 172.21.15.73:0/4115750369 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329171391 0 0) 0x7f905c09ca00 con 0x7f905c138d40 2024-09-11T01:58:25.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:25.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:25.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:25.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient(hunting): my global_id is 4275 2024-09-11T01:58:25.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 -- 172.21.15.73:0/4115750369 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9044003520 con 0x7f905c138d40 2024-09-11T01:58:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 -- 172.21.15.73:0/4115750369 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4210771137 0 0) 0x7f9044003520 con 0x7f905c138d40 2024-09-11T01:58:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 -- 172.21.15.73:0/4115750369 >> v1:172.21.15.203:6792/0 conn(0x7f905c13f350 legacy=0x7f905c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 -- 172.21.15.73:0/4115750369 >> v1:172.21.15.203:6789/0 conn(0x7f905c0a72f0 legacy=0x7f905c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 monclient: found mon.noname-a 2024-09-11T01:58:25.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:25.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:25.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 -- 172.21.15.73:0/4115750369 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c09d1c0 con 0x7f905c138d40 2024-09-11T01:58:25.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:25.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:25.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:25.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 5 monclient: authenticate success, global_id 4275 2024-09-11T01:58:25.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 -- 172.21.15.73:0/4115750369 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f904c001bd0 con 0x7f905c138d40 2024-09-11T01:58:25.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:25.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:25.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:25.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: dump: 2024-09-11T01:58:25.178 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:25.179 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:25.180 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:25.181 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:25.181 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:25.181 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:25.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:25.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 -- 172.21.15.73:0/4115750369 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f904c001df0 con 0x7f905c138d40 2024-09-11T01:58:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 1 -- 172.21.15.73:0/4115750369 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f904c004f60 con 0x7f905c138d40 2024-09-11T01:58:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f9061cc6640 4 set_mon_vals no callback set 2024-09-11T01:58:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:25.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:25.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.156+0000 7f905a7fc640 10 monclient: dump: 2024-09-11T01:58:25.183 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:25.183 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:25.183 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.183 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.183 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:25.184 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:25.184 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:25.184 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:25.184 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:25.184 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:25.185 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:25.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.157+0000 7f9061cc6640 10 monclient: shutdown 2024-09-11T01:58:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.157+0000 7f9061cc6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.157+0000 7f9061cc6640 1 -- 172.21.15.73:0/4115750369 >> v1:172.21.15.73:6789/0 conn(0x7f905c138d40 legacy=0x7f905c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.157+0000 7f9061cc6640 1 -- 172.21.15.73:0/4115750369 shutdown_connections 2024-09-11T01:58:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.157+0000 7f9061cc6640 1 -- 172.21.15.73:0/4115750369 >> 172.21.15.73:0/4115750369 conn(0x7f905c0a8050 msgr2=0x7f905c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.157+0000 7f9061cc6640 1 -- 172.21.15.73:0/4115750369 shutdown_connections 2024-09-11T01:58:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.157+0000 7f9061cc6640 1 -- 172.21.15.73:0/4115750369 wait complete. 2024-09-11T01:58:25.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.158+0000 7f9061cc6640 10 monclient: build_initial_monmap 2024-09-11T01:58:25.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.158+0000 7f9061cc6640 10 monclient: monmap: 2024-09-11T01:58:25.187 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:25.187 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:25.187 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:25.187 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:25.187 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.158+0000 7f9061cc6640 1 Processor -- start 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.158+0000 7f9061cc6640 1 -- start start 2024-09-11T01:58:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.158+0000 7f9061cc6640 10 monclient: init 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.158+0000 7f9061cc6640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.158+0000 7f9061cc6640 10 monclient: _add_conns ranks=[5,2,4,6,3,1,8,0,7] 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.158+0000 7f9061cc6640 10 monclient(hunting): picked mon.noname-h con 0x7f905c0a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 10 monclient(hunting): picked mon.noname-b con 0x7f905c138d40 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 10 monclient(hunting): picked mon.noname-c con 0x7f905c13f350 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c142880 con 0x7f905c138d40 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c141fc0 con 0x7f905c13f350 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c1422a0 con 0x7f905c0a72f0 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 10 monclient(hunting): authenticate will time out at 746.763060s 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f905affd640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f905c138d40 0x7f905c13fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41016/0 (socket says 172.21.15.73:41016) 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f905affd640 1 -- 172.21.15.73:0/2946228091 learned_addr learned my addr 172.21.15.73:0/2946228091 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f905bfff640 1 --1- 172.21.15.73:0/2946228091 >> v1:172.21.15.73:6791/0 conn(0x7f905c13f350 0x7f905c1d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51830/0 (socket says 172.21.15.73:51830) 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145766908 0 0) 0x7f905c141fc0 con 0x7f905c13f350 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): my global_id is 4270 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9048003520 con 0x7f905c13f350 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647766917 0 0) 0x7f905c0a7070 con 0x7f905c138d40 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): my global_id is 4241 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f905c141fc0 con 0x7f905c138d40 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767666106 0 0) 0x7f905c1422a0 con 0x7f905c0a72f0 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): my global_id is 4262 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f905c0a7070 con 0x7f905c0a72f0 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4160757685 0 0) 0x7f9048003520 con 0x7f905c13f350 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f905c1422a0 con 0x7f905c13f350 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1825297006 0 0) 0x7f905c141fc0 con 0x7f905c138d40 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9048003520 con 0x7f905c138d40 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f90540019f0 con 0x7f905c13f350 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): dump: 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2770209141 0 0) 0x7f905c0a7070 con 0x7f905c0a72f0 2024-09-11T01:58:25.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f905c141fc0 con 0x7f905c0a72f0 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9050001a90 con 0x7f905c138d40 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): dump: 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f904c004ea0 con 0x7f905c0a72f0 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient(hunting): dump: 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4255939386 0 0) 0x7f905c1422a0 con 0x7f905c13f350 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 >> v1:172.21.15.203:6791/0 conn(0x7f905c0a72f0 legacy=0x7f905c13f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 >> v1:172.21.15.73:6790/0 conn(0x7f905c138d40 legacy=0x7f905c13fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 monclient: found mon.c 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c140550 con 0x7f905c13f350 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient: _finish_auth 0 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9043fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 5 monclient: authenticate success, global_id 4270 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 10 monclient: _renew_subs 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f905c0a5330 con 0x7f905c13f350 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 10 monclient: _renew_subs 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.159+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f905c13e770 con 0x7f905c13f350 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9054001d30 con 0x7f905c13f350 2024-09-11T01:58:25.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9043fff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9054003c00 con 0x7f905c13f350 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9043fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9059ffb640 4 set_mon_vals no callback set 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9043fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9043fff640 10 monclient: dump: 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:25.198 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9054003e20 con 0x7f905c13f350 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9061cc6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9061cc6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9061cc6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.160+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903c005080 con 0x7f905c13f350 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.161+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(16..16 src has 1..16) ==== 3153+0+0 (unknown 3523531802 0 0) 0x7f905404e120 con 0x7f905c13f350 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.161+0000 7f905b7fe640 10 monclient: get_auth_request con 0x7f90480406b0 auth_method 0 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.165+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f90540175c0 con 0x7f905c13f350 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.165+0000 7f9043fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:25.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.165+0000 7f9043fff640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:25.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.339+0000 7f9061cc6640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-09-11T01:58:25.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.339+0000 7f9061cc6640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-09-11T01:58:25.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.339+0000 7f9061cc6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:25.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.339+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f903c005c40 con 0x7f905c13f350 2024-09-11T01:58:25.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.979+0000 7f9043fff640 1 -- 172.21.15.73:0/2946228091 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) ==== 109+0+0 (unknown 1910661782 0 0) 0x7f9054016ec0 con 0x7f905c13f350 2024-09-11T01:58:25.982 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2024-09-11T01:58:25.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.979+0000 7f9043fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-09-11T01:58:25.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.979+0000 7f9043fff640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-09-11T01:58:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.985+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 >> v1:172.21.15.203:6812/2311533528 conn(0x7f90480406b0 legacy=0x7f9048042b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.985+0000 7f9061cc6640 10 monclient: shutdown 2024-09-11T01:58:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.985+0000 7f9061cc6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.985+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 >> v1:172.21.15.73:6791/0 conn(0x7f905c13f350 legacy=0x7f905c1d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.986+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 shutdown_connections 2024-09-11T01:58:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.986+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 >> 172.21.15.73:0/2946228091 conn(0x7f905c0a8050 msgr2=0x7f905c0a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.986+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 shutdown_connections 2024-09-11T01:58:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:25.986+0000 7f9061cc6640 1 -- 172.21.15.73:0/2946228091 wait complete. 2024-09-11T01:58:26.002 DEBUG:teuthology.orchestra.run.smithi073:> rbd --cluster ceph pool init rbd 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.060+0000 7f297e787140 10 monclient: get_monmap_and_config 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.060+0000 7f297e787140 10 monclient: build_initial_monmap 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.060+0000 7f297e787140 10 monclient: monmap: 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:26.061201+0000 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:26.061201+0000 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:26.062 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:26.063 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:26.063 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:26.063 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:26.063 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:26.063 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:26.063 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:26.063 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:26.063 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:26.063 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:26.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 1 Processor -- start 2024-09-11T01:58:26.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 1 -- start start 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 10 monclient: init 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 10 monclient: _reopen_session rank -1 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 10 monclient: _add_conns ranks=[3,1,8,6,0,7,2,5,4] 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 10 monclient(hunting): picked mon.noname-g con 0x55cbff89e8f0 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 10 monclient(hunting): picked mon.noname-f con 0x55cbff808f10 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 10 monclient(hunting): picked mon.noname-e con 0x55cbff80a450 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55cbff689d90 con 0x55cbff808f10 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55cbff6a1410 con 0x55cbff89e8f0 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55cbff658720 con 0x55cbff80a450 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 10 monclient(hunting): _renew_subs 2024-09-11T01:58:26.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e787140 10 monclient(hunting): authenticate will time out at 747.665721s 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e4d4640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x55cbff80a450 0x55cbff8a8780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38786/0 (socket says 172.21.15.73:38786) 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.061+0000 7f297e4d4640 1 -- 172.21.15.73:0/1956791092 learned_addr learned my addr 172.21.15.73:0/1956791092 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 -- 172.21.15.73:0/1956791092 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452628131 0 0) 0x55cbff658720 con 0x55cbff80a450 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient(hunting): my global_id is 4220 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 -- 172.21.15.73:0/1956791092 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2964001e10 con 0x55cbff80a450 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 -- 172.21.15.73:0/1956791092 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2523313578 0 0) 0x7f2964001e10 con 0x55cbff80a450 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 -- 172.21.15.73:0/1956791092 >> v1:172.21.15.203:6790/0 conn(0x55cbff89e8f0 legacy=0x55cbff89f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 -- 172.21.15.73:0/1956791092 >> v1:172.21.15.203:6789/0 conn(0x55cbff808f10 legacy=0x55cbff89fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 monclient: found mon.noname-e 2024-09-11T01:58:26.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 -- 172.21.15.73:0/1956791092 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbff8a01f0 con 0x55cbff80a450 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: _finish_auth 0 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 5 monclient: authenticate success, global_id 4220 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 -- 172.21.15.73:0/1956791092 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2970001bb0 con 0x55cbff80a450 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: dump: 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 -- 172.21.15.73:0/1956791092 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2970001dd0 con 0x55cbff80a450 2024-09-11T01:58:26.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 10 monclient: get_monmap_and_config success 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 1 -- 172.21.15.73:0/1956791092 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2970003850 con 0x55cbff80a450 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 4 set_mon_vals no callback set 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f296ffff640 10 monclient: dump: 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:26.076 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 10 monclient: shutdown 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 1 -- 172.21.15.73:0/1956791092 >> v1:172.21.15.73:6793/0 conn(0x55cbff80a450 legacy=0x55cbff8a8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 1 -- 172.21.15.73:0/1956791092 shutdown_connections 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.062+0000 7f297e787140 1 -- 172.21.15.73:0/1956791092 >> 172.21.15.73:0/1956791092 conn(0x55cbff7ef8b0 msgr2=0x55cbff7efcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.063+0000 7f297e787140 1 -- 172.21.15.73:0/1956791092 shutdown_connections 2024-09-11T01:58:26.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.063+0000 7f297e787140 1 -- 172.21.15.73:0/1956791092 wait complete. 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.063+0000 7f297e787140 10 monclient: build_initial_monmap 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.063+0000 7f297e787140 10 monclient: monmap: 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:26.078 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.063+0000 7f297e787140 1 Processor -- start 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.063+0000 7f297e787140 1 -- start start 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.063+0000 7f297e787140 10 monclient: init 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 10 monclient: _reopen_session rank -1 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 10 monclient: _add_conns ranks=[4,6,1,8,5,2,3,0,7] 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 10 monclient(hunting): picked mon.noname-c con 0x55cbff80a450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 10 monclient(hunting): picked mon.noname-d con 0x55cbff89e8f0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 10 monclient(hunting): picked mon.noname-f con 0x55cbff8b48f0 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:26.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55cbff888440 con 0x55cbff8b48f0 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55cbff888720 con 0x55cbff80a450 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55cbff89db50 con 0x55cbff89e8f0 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 10 monclient(hunting): _renew_subs 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297e787140 10 monclient(hunting): authenticate will time out at 747.668284s 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297d272640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x55cbff80a450 0x55cbff804510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51836/0 (socket says 172.21.15.73:51836) 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297d272640 1 -- 172.21.15.73:0/2159077855 learned_addr learned my addr 172.21.15.73:0/2159077855 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f297ca71640 1 --1- 172.21.15.73:0/2159077855 >> v1:172.21.15.73:6792/0 conn(0x55cbff89e8f0 0x55cbff804c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:38098/0 (socket says 172.21.15.73:38098) 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706160466 0 0) 0x55cbff888720 con 0x55cbff80a450 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): my global_id is 4279 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f295c001e10 con 0x55cbff80a450 2024-09-11T01:58:26.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1568541786 0 0) 0x55cbff89db50 con 0x55cbff89e8f0 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): my global_id is 4227 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55cbff888720 con 0x55cbff89e8f0 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835893033 0 0) 0x55cbff888440 con 0x55cbff8b48f0 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): my global_id is 4231 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55cbff89db50 con 0x55cbff8b48f0 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1448020758 0 0) 0x7f295c001e10 con 0x55cbff80a450 2024-09-11T01:58:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55cbff888440 con 0x55cbff80a450 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2974001ad0 con 0x55cbff80a450 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:26.082 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3152210576 0 0) 0x55cbff888720 con 0x55cbff89e8f0 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f295c001e10 con 0x55cbff89e8f0 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2968001ab0 con 0x55cbff89e8f0 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.064+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3469773866 0 0) 0x55cbff89db50 con 0x55cbff8b48f0 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55cbff888720 con 0x55cbff8b48f0 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2970003790 con 0x55cbff8b48f0 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:26.085 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1873762255 0 0) 0x55cbff888440 con 0x55cbff80a450 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 >> v1:172.21.15.73:6792/0 conn(0x55cbff89e8f0 legacy=0x55cbff804c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 >> v1:172.21.15.203:6789/0 conn(0x55cbff8b48f0 legacy=0x55cbff8b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:26.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 1 monclient: found mon.c 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbff80cde0 con 0x55cbff80a450 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f297e787140 5 monclient: authenticate success, global_id 4279 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f297e787140 10 monclient: _renew_subs 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f297e787140 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x55cbff888180 con 0x55cbff80a450 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f297e787140 10 monclient: _renew_subs 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f297e787140 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x55cbff807460 con 0x55cbff80a450 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29740021b0 con 0x55cbff80a450 2024-09-11T01:58:26.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2974002720 con 0x55cbff80a450 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296d7fa640 10 monclient: dump: 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:26.088 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.065+0000 7f296f7fe640 4 set_mon_vals no callback set 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.066+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f29740028c0 con 0x55cbff80a450 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.066+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(17..17 src has 1..17) ==== 3495+0+0 (unknown 3822248552 0 0) 0x7f297404ca60 con 0x55cbff80a450 2024-09-11T01:58:26.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.066+0000 7f297e787140 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-09-11T01:58:26.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.066+0000 7f297e787140 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-09-11T01:58:26.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.066+0000 7f297e787140 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:26.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.066+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55cbff806d90 con 0x55cbff80a450 2024-09-11T01:58:26.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.066+0000 7f297ca71640 10 monclient: get_auth_request con 0x7f295c041200 auth_method 0 2024-09-11T01:58:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.987+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v18) ==== 141+0+0 (unknown 660702925 0 0) 0x7f2974015d90 con 0x55cbff80a450 2024-09-11T01:58:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.987+0000 7f296d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-09-11T01:58:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.987+0000 7f296d7fa640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2024-09-11T01:58:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.987+0000 7f297e787140 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:26.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.987+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2970001dd0 con 0x55cbff80a450 2024-09-11T01:58:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.994+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f2974001c70 con 0x55cbff80a450 2024-09-11T01:58:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.994+0000 7f296d7fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2024-09-11T01:58:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.994+0000 7f296f7fe640 10 monclient: _renew_subs 2024-09-11T01:58:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.994+0000 7f296f7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.994+0000 7f296f7fe640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=18}) -- 0x7f2954002bc0 con 0x55cbff80a450 2024-09-11T01:58:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.994+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 11 ==== osd_map(18..18 src has 1..18) ==== 658+0+0 (unknown 595432234 0 0) 0x7f297404b920 con 0x55cbff80a450 2024-09-11T01:58:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.994+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.203:6800/464336651 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x55cbff8bbb30 con 0x55cbff7eeab0 2024-09-11T01:58:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:26.995+0000 7f297e4d4640 10 monclient: get_auth_request con 0x55cbff7eeab0 auth_method 0 2024-09-11T01:58:27.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.000+0000 7f297e4d4640 1 -- 172.21.15.73:0/2159077855 <== osd.5 v1:172.21.15.203:6800/464336651 1 ==== osd_op_reply(1 rbd_trash [create] v18'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 785457554 0 0) 0x7f2970001f80 con 0x55cbff7eeab0 2024-09-11T01:58:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.003+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.203:6800/464336651 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55cbff90dc30 con 0x55cbff7eeab0 2024-09-11T01:58:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.003+0000 7f297e4d4640 1 -- 172.21.15.73:0/2159077855 <== osd.5 v1:172.21.15.203:6800/464336651 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1898125418 0 0) 0x7f2970001f80 con 0x55cbff7eeab0 2024-09-11T01:58:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.003+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.203:6800/464336651 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55cbff90cd40 con 0x55cbff7eeab0 2024-09-11T01:58:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.004+0000 7f297e4d4640 1 -- 172.21.15.73:0/2159077855 <== osd.5 v1:172.21.15.203:6800/464336651 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1886642790 0 0) 0x7f2970001f80 con 0x55cbff7eeab0 2024-09-11T01:58:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.004+0000 7f296effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:27.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.004+0000 7f296effd640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f2958001f00 con 0x55cbff80a450 2024-09-11T01:58:27.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.985+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 12 ==== pool_op_reply(tid 4 (0) Success v19) ==== 55+0+0 (unknown 3517532507 0 0) 0x7f2974015690 con 0x55cbff80a450 2024-09-11T01:58:27.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.985+0000 7f296d7fa640 10 monclient: _renew_subs 2024-09-11T01:58:27.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.985+0000 7f296d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:27.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.985+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=19}) -- 0x55cbff888440 con 0x55cbff80a450 2024-09-11T01:58:27.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.985+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 13 ==== osd_map(19..19 src has 1..19) ==== 626+0+0 (unknown 1659545259 0 0) 0x7f2974014950 con 0x55cbff80a450 2024-09-11T01:58:27.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.985+0000 7f296f7fe640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.203:6800/464336651 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f29540058b0 con 0x55cbff7eeab0 2024-09-11T01:58:27.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.989+0000 7f297e4d4640 1 -- 172.21.15.73:0/2159077855 <== osd.5 v1:172.21.15.203:6800/464336651 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v19'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 1570664900 0 0) 0x7f2970001f80 con 0x55cbff7eeab0 2024-09-11T01:58:27.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.989+0000 7f296effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:27.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:27.989+0000 7f296effd640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v19) -- 0x7f2958003370 con 0x55cbff80a450 2024-09-11T01:58:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.988+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 14 ==== pool_op_reply(tid 6 (0) Success v20) ==== 43+0+0 (unknown 3905563015 0 0) 0x7f297401eb60 con 0x55cbff80a450 2024-09-11T01:58:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.988+0000 7f296d7fa640 10 monclient: _renew_subs 2024-09-11T01:58:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.988+0000 7f296d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.988+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=20}) -- 0x7f295c001e10 con 0x55cbff80a450 2024-09-11T01:58:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.988+0000 7f296d7fa640 1 -- 172.21.15.73:0/2159077855 <== mon.4 v1:172.21.15.73:6791/0 15 ==== osd_map(20..20 src has 1..20) ==== 654+0+0 (unknown 1831719694 0 0) 0x7f29740146b0 con 0x55cbff80a450 2024-09-11T01:58:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.988+0000 7f296f7fe640 1 -- 172.21.15.73:0/2159077855 --> v1:172.21.15.203:6800/464336651 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20) -- 0x7f2954005cb0 con 0x55cbff7eeab0 2024-09-11T01:58:28.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.996+0000 7f297e4d4640 1 -- 172.21.15.73:0/2159077855 <== osd.5 v1:172.21.15.203:6800/464336651 5 ==== osd_op_reply(7 rbd_info [write 0~19] v20'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 1721084249 0 0) 0x7f2970001f80 con 0x55cbff7eeab0 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 >> v1:172.21.15.203:6800/464336651 conn(0x55cbff7eeab0 legacy=0x55cbff8ba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 >> v1:172.21.15.203:6812/2311533528 conn(0x7f295c041200 legacy=0x7f295c0436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e787140 10 monclient: shutdown 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e787140 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 >> v1:172.21.15.73:6791/0 conn(0x55cbff80a450 legacy=0x55cbff804510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e4d4640 1 -- 172.21.15.73:0/2159077855 reap_dead start 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 shutdown_connections 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 >> 172.21.15.73:0/2159077855 conn(0x55cbff7ef8b0 msgr2=0x55cbff89ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 shutdown_connections 2024-09-11T01:58:28.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:28.997+0000 7f297e787140 1 -- 172.21.15.73:0/2159077855 wait complete. 2024-09-11T01:58:29.003 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T01:58:29.003 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-11T01:58:29.004 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T01:58:29.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.105+0000 7f8d541a3640 10 monclient: get_monmap_and_config 2024-09-11T01:58:29.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.105+0000 7f8d541a3640 10 monclient: build_initial_monmap 2024-09-11T01:58:29.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.105+0000 7f8d541a3640 10 monclient: monmap: 2024-09-11T01:58:29.108 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:29.108 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.108 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:29.106485+0000 2024-09-11T01:58:29.109 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:29.106485+0000 2024-09-11T01:58:29.109 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:29.109 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.109 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:29.110 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:29.110 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:29.110 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:29.110 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:29.110 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:29.110 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:29.111 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:29.111 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:29.111 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 1 Processor -- start 2024-09-11T01:58:29.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 1 -- start start 2024-09-11T01:58:29.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 10 monclient: init 2024-09-11T01:58:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 10 monclient: _add_conns ranks=[3,7,5,4,0,2,1,8,6] 2024-09-11T01:58:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 10 monclient(hunting): picked mon.noname-g con 0x7f8d4c138d40 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 10 monclient(hunting): picked mon.noname-i con 0x7f8d4c0a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 10 monclient(hunting): picked mon.noname-h con 0x7f8d4c13f350 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d4c09ca00 con 0x7f8d4c138d40 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d4c0a7070 con 0x7f8d4c13f350 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d4c09cee0 con 0x7f8d4c0a72f0 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.106+0000 7f8d541a3640 10 monclient(hunting): authenticate will time out at 750.710910s 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d52740640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7f8d4c13f350 0x7f8d4c141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.73:55550/0 (socket says 172.21.15.73:55550) 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d51f3f640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7f8d4c138d40 0x7f8d4c139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.73:41194/0 (socket says 172.21.15.73:41194) 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d52740640 1 -- 172.21.15.73:0/963037316 learned_addr learned my addr 172.21.15.73:0/963037316 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d5173e640 1 --1- 172.21.15.73:0/963037316 >> v1:172.21.15.203:6792/0 conn(0x7f8d4c0a72f0 0x7f8d4c13dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6792/0 says I am v1:172.21.15.73:51628/0 (socket says 172.21.15.73:51628) 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634734753 0 0) 0x7f8d4c09cee0 con 0x7f8d4c0a72f0 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): my global_id is 4192 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d38003520 con 0x7f8d4c0a72f0 2024-09-11T01:58:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803925263 0 0) 0x7f8d4c0a7070 con 0x7f8d4c13f350 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): my global_id is 4271 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d4c09cee0 con 0x7f8d4c13f350 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678925226 0 0) 0x7f8d4c09ca00 con 0x7f8d4c138d40 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient(hunting): my global_id is 4278 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d4c0a7070 con 0x7f8d4c138d40 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3708029435 0 0) 0x7f8d4c09cee0 con 0x7f8d4c13f350 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 >> v1:172.21.15.203:6792/0 conn(0x7f8d4c0a72f0 legacy=0x7f8d4c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 >> v1:172.21.15.203:6790/0 conn(0x7f8d4c138d40 legacy=0x7f8d4c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: _finish_hunting 0 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 monclient: found mon.noname-h 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.203:6791/0 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4c09d1c0 con 0x7f8d4c13f350 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: _finish_auth 0 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: _check_auth_tickets 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d44001b90 con 0x7f8d4c13f350 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: dump: 2024-09-11T01:58:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d541a3640 5 monclient: authenticate success, global_id 4271 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d541a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 <== mon.5 v1:172.21.15.203:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d44001d30 con 0x7f8d4c13f350 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d541a3640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d541a3640 4 set_mon_vals no callback set 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 1 -- 172.21.15.73:0/963037316 <== mon.5 v1:172.21.15.203:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d44004f60 con 0x7f8d4c13f350 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.107+0000 7f8d50f3d640 10 monclient: dump: 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.127 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.108+0000 7f8d541a3640 10 monclient: shutdown 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.108+0000 7f8d541a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.108+0000 7f8d541a3640 1 -- 172.21.15.73:0/963037316 >> v1:172.21.15.203:6791/0 conn(0x7f8d4c13f350 legacy=0x7f8d4c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.108+0000 7f8d541a3640 1 -- 172.21.15.73:0/963037316 shutdown_connections 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.108+0000 7f8d541a3640 1 -- 172.21.15.73:0/963037316 >> 172.21.15.73:0/963037316 conn(0x7f8d4c0a8050 msgr2=0x7f8d4c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.108+0000 7f8d541a3640 1 -- 172.21.15.73:0/963037316 shutdown_connections 2024-09-11T01:58:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.108+0000 7f8d541a3640 1 -- 172.21.15.73:0/963037316 wait complete. 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient: build_initial_monmap 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient: monmap: 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 1 Processor -- start 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 1 -- start start 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient: init 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient: _add_conns ranks=[5,4,8,6,7,2,0,3,1] 2024-09-11T01:58:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient(hunting): picked mon.noname-h con 0x7f8d4c0a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient(hunting): picked mon.noname-c con 0x7f8d4c138d40 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient(hunting): picked mon.noname-e con 0x7f8d4c13f350 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d4c1428f0 con 0x7f8d4c138d40 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d4c13afd0 con 0x7f8d4c0a72f0 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d4c13ca20 con 0x7f8d4c13f350 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d541a3640 10 monclient(hunting): authenticate will time out at 750.713876s 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d5173e640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f8d4c138d40 0x7f8d4c1d2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51850/0 (socket says 172.21.15.73:51850) 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d5173e640 1 -- 172.21.15.73:0/4098232241 learned_addr learned my addr 172.21.15.73:0/4098232241 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.109+0000 7f8d52740640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f8d4c13f350 0x7f8d4c1d5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38810/0 (socket says 172.21.15.73:38810) 2024-09-11T01:58:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957018970 0 0) 0x7f8d4c13ca20 con 0x7f8d4c13f350 2024-09-11T01:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): my global_id is 4229 2024-09-11T01:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d30003520 con 0x7f8d4c13f350 2024-09-11T01:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425538065 0 0) 0x7f8d4c1428f0 con 0x7f8d4c138d40 2024-09-11T01:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): my global_id is 4288 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d4c13ca20 con 0x7f8d4c138d40 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223479674 0 0) 0x7f8d4c13afd0 con 0x7f8d4c0a72f0 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): my global_id is 4280 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d4c1428f0 con 0x7f8d4c0a72f0 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1049607688 0 0) 0x7f8d4c13ca20 con 0x7f8d4c138d40 2024-09-11T01:58:29.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d4c13afd0 con 0x7f8d4c138d40 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3310060144 0 0) 0x7f8d30003520 con 0x7f8d4c13f350 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d4c13ca20 con 0x7f8d4c13f350 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d3c001a20 con 0x7f8d4c138d40 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): dump: 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d44001b50 con 0x7f8d4c13f350 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): dump: 2024-09-11T01:58:29.135 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.136 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1895368758 0 0) 0x7f8d4c1428f0 con 0x7f8d4c0a72f0 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d30003520 con 0x7f8d4c0a72f0 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d480013e0 con 0x7f8d4c0a72f0 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient(hunting): dump: 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.138 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2668696962 0 0) 0x7f8d4c13afd0 con 0x7f8d4c138d40 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 >> v1:172.21.15.73:6793/0 conn(0x7f8d4c13f350 legacy=0x7f8d4c1d5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 >> v1:172.21.15.203:6791/0 conn(0x7f8d4c0a72f0 legacy=0x7f8d4c13e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 monclient: found mon.c 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:29.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4c13cd00 con 0x7f8d4c138d40 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d541a3640 5 monclient: authenticate success, global_id 4288 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d541a3640 10 monclient: _renew_subs 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d541a3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4c13bac0 con 0x7f8d4c138d40 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d541a3640 10 monclient: _renew_subs 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d541a3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f8d4c13f0e0 con 0x7f8d4c138d40 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d3c004a90 con 0x7f8d4c138d40 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:29.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d3c001bc0 con 0x7f8d4c138d40 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d43fff640 4 set_mon_vals no callback set 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.110+0000 7f8d427fc640 10 monclient: dump: 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.141 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.111+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f8d3c011520 con 0x7f8d4c138d40 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.111+0000 7f8d541a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.111+0000 7f8d541a3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.111+0000 7f8d541a3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.111+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d34005080 con 0x7f8d4c138d40 2024-09-11T01:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.111+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f8d3c04e300 con 0x7f8d4c138d40 2024-09-11T01:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.112+0000 7f8d51f3f640 10 monclient: get_auth_request con 0x7f8d30040710 auth_method 0 2024-09-11T01:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.116+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f8d3c0174f0 con 0x7f8d4c138d40 2024-09-11T01:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.116+0000 7f8d427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.116+0000 7f8d427fc640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.290+0000 7f8d541a3640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2024-09-11T01:58:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.290+0000 7f8d541a3640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-09-11T01:58:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.290+0000 7f8d541a3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:29.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.290+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f8d34005370 con 0x7f8d4c138d40 2024-09-11T01:58:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.290+0000 7f8d427fc640 1 -- 172.21.15.73:0/4098232241 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (unknown 882900978 0 1459858466) 0x7f8d3c01b8d0 con 0x7f8d4c138d40 2024-09-11T01:58:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.290+0000 7f8d427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-09-11T01:58:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.290+0000 7f8d427fc640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:29.293 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:29.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.292+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 >> v1:172.21.15.203:6812/2311533528 conn(0x7f8d30040710 legacy=0x7f8d30042bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.293+0000 7f8d541a3640 10 monclient: shutdown 2024-09-11T01:58:29.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.293+0000 7f8d541a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:29.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.293+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 >> v1:172.21.15.73:6791/0 conn(0x7f8d4c138d40 legacy=0x7f8d4c1d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.293+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 shutdown_connections 2024-09-11T01:58:29.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.293+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 >> 172.21.15.73:0/4098232241 conn(0x7f8d4c0a8050 msgr2=0x7f8d4c0a0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:29.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.293+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 shutdown_connections 2024-09-11T01:58:29.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.293+0000 7f8d541a3640 1 -- 172.21.15.73:0/4098232241 wait complete. 2024-09-11T01:58:29.304 INFO:teuthology.orchestra.run.smithi073.stdout:[{"version":5,"timestamp":"2024-09-11T01:58:19.769025+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"6921.797796"}]}] 2024-09-11T01:58:29.305 INFO:tasks.ceph_manager:config epoch is 5 2024-09-11T01:58:29.305 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T01:58:29.305 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T01:58:29.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T01:58:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.400+0000 7feb327a1640 10 monclient: get_monmap_and_config 2024-09-11T01:58:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.400+0000 7feb327a1640 10 monclient: build_initial_monmap 2024-09-11T01:58:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.401+0000 7feb327a1640 10 monclient: monmap: 2024-09-11T01:58:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:29.401838+0000 2024-09-11T01:58:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:29.401838+0000 2024-09-11T01:58:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:29.404 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:29.405 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.401+0000 7feb327a1640 1 Processor -- start 2024-09-11T01:58:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.401+0000 7feb327a1640 1 -- start start 2024-09-11T01:58:29.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.401+0000 7feb327a1640 10 monclient: init 2024-09-11T01:58:29.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:29.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 10 monclient: _add_conns ranks=[7,8,5,3,0,4,1,6,2] 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 10 monclient(hunting): picked mon.noname-i con 0x7feb2c0a5a30 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 10 monclient(hunting): picked mon.noname-e con 0x7feb2c0a3b40 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 10 monclient(hunting): picked mon.noname-h con 0x7feb2c0a6520 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2c0a1ea0 con 0x7feb2c0a6520 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2c0a28c0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2c0a6da0 con 0x7feb2c0a3b40 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 10 monclient(hunting): authenticate will time out at 751.006331s 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb30f9e640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7feb2c0a3b40 0x7feb2c13dc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38818/0 (socket says 172.21.15.73:38818) 2024-09-11T01:58:29.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb30f9e640 1 -- 172.21.15.73:0/526588168 learned_addr learned my addr 172.21.15.73:0/526588168 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134004849 0 0) 0x7feb2c0a6da0 con 0x7feb2c0a3b40 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): my global_id is 4238 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb18003520 con 0x7feb2c0a3b40 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1238095237 0 0) 0x7feb2c0a1ea0 con 0x7feb2c0a6520 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): my global_id is 4289 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb2c0a6da0 con 0x7feb2c0a6520 2024-09-11T01:58:29.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921306583 0 0) 0x7feb2c0a28c0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient(hunting): my global_id is 4201 2024-09-11T01:58:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb2c0a1ea0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4241957739 0 0) 0x7feb18003520 con 0x7feb2c0a3b40 2024-09-11T01:58:29.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 >> v1:172.21.15.203:6792/0 conn(0x7feb2c0a5a30 legacy=0x7feb2c0a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 >> v1:172.21.15.203:6791/0 conn(0x7feb2c0a6520 legacy=0x7feb2c141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 monclient: found mon.noname-e 2024-09-11T01:58:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T01:58:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c0a6af0 con 0x7feb2c0a3b40 2024-09-11T01:58:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient: _finish_auth 0 2024-09-11T01:58:29.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb1c0017b0 con 0x7feb2c0a3b40 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 5 monclient: authenticate success, global_id 4238 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb23fff640 10 monclient: dump: 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.420 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.421 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.402+0000 7feb327a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb1c001950 con 0x7feb2c0a3b40 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb23fff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb23fff640 1 -- 172.21.15.73:0/526588168 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb1c004be0 con 0x7feb2c0a3b40 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb327a1640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb327a1640 4 set_mon_vals no callback set 2024-09-11T01:58:29.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb23fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb23fff640 10 monclient: dump: 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.423 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb327a1640 10 monclient: shutdown 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb327a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb327a1640 1 -- 172.21.15.73:0/526588168 >> v1:172.21.15.73:6793/0 conn(0x7feb2c0a3b40 legacy=0x7feb2c13dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb327a1640 1 -- 172.21.15.73:0/526588168 shutdown_connections 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb327a1640 1 -- 172.21.15.73:0/526588168 >> 172.21.15.73:0/526588168 conn(0x7feb2c0a7b30 msgr2=0x7feb2c0a7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:29.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb327a1640 1 -- 172.21.15.73:0/526588168 shutdown_connections 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.403+0000 7feb327a1640 1 -- 172.21.15.73:0/526588168 wait complete. 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 10 monclient: build_initial_monmap 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 10 monclient: monmap: 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:29.425 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 1 Processor -- start 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 1 -- start start 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 10 monclient: init 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 10 monclient: _add_conns ranks=[5,2,1,6,7,8,0,4,3] 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 10 monclient(hunting): picked mon.noname-h con 0x7feb2c0a3b40 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 10 monclient(hunting): picked mon.noname-b con 0x7feb2c0a5a30 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:29.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.404+0000 7feb327a1640 10 monclient(hunting): picked mon.noname-f con 0x7feb2c0a6520 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2c134f20 con 0x7feb2c0a6520 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2c0a14b0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2c06ea90 con 0x7feb2c0a3b40 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 10 monclient(hunting): authenticate will time out at 751.009074s 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb30f9e640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7feb2c0a5a30 0x7feb2c134810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41026/0 (socket says 172.21.15.73:41026) 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb30f9e640 1 -- 172.21.15.73:0/1695822879 learned_addr learned my addr 172.21.15.73:0/1695822879 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656653886 0 0) 0x7feb2c0a14b0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): my global_id is 4250 2024-09-11T01:58:29.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb10003520 con 0x7feb2c0a5a30 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590211932 0 0) 0x7feb2c06ea90 con 0x7feb2c0a3b40 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): my global_id is 4298 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb2c0a14b0 con 0x7feb2c0a3b40 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353158384 0 0) 0x7feb2c134f20 con 0x7feb2c0a6520 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): my global_id is 4240 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb2c06ea90 con 0x7feb2c0a6520 2024-09-11T01:58:29.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3465454870 0 0) 0x7feb10003520 con 0x7feb2c0a5a30 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb2c134f20 con 0x7feb2c0a5a30 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb1c0017b0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): dump: 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.429 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.430 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.430 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3636602160 0 0) 0x7feb2c0a14b0 con 0x7feb2c0a3b40 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb10003520 con 0x7feb2c0a3b40 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb28001d90 con 0x7feb2c0a3b40 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient(hunting): dump: 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.431 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.432 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1426834429 0 0) 0x7feb2c134f20 con 0x7feb2c0a5a30 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 >> v1:172.21.15.203:6791/0 conn(0x7feb2c0a3b40 legacy=0x7feb2c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 >> v1:172.21.15.203:6789/0 conn(0x7feb2c0a6520 legacy=0x7feb2c1d59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient: _finish_hunting 0 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 monclient: found mon.b 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c0a1090 con 0x7feb2c0a5a30 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient: _finish_auth 0 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient: _check_auth_tickets 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:29.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 5 monclient: authenticate success, global_id 4250 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 10 monclient: _renew_subs 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c136ef0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb1c004bd0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb1c0051e0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb21ffb640 10 monclient: dump: 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.434 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 10 monclient: _renew_subs 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb237fe640 4 set_mon_vals no callback set 2024-09-11T01:58:29.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.405+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7feb2c1375f0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.406+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7feb1c011920 con 0x7feb2c0a5a30 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.406+0000 7feb327a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.406+0000 7feb327a1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.406+0000 7feb327a1640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.406+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2c1359d0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.407+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7feb1c04e1f0 con 0x7feb2c0a5a30 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.407+0000 7feb3179f640 10 monclient: get_auth_request con 0x7feb100403c0 auth_method 0 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.411+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7feb1c017500 con 0x7feb2c0a5a30 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.411+0000 7feb21ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:29.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.411+0000 7feb21ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.634+0000 7feb327a1640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-09-11T01:58:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.634+0000 7feb327a1640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-09-11T01:58:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.634+0000 7feb327a1640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.634+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7feb2c069350 con 0x7feb2c0a5a30 2024-09-11T01:58:29.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.635+0000 7feb21ffb640 1 -- 172.21.15.73:0/1695822879 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+97312 (unknown 481731318 0 287595099) 0x7feb1c016e00 con 0x7feb2c0a5a30 2024-09-11T01:58:29.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.635+0000 7feb21ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-09-11T01:58:29.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.635+0000 7feb21ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:29.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:29.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.638+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 >> v1:172.21.15.203:6812/2311533528 conn(0x7feb100403c0 legacy=0x7feb10042880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.638+0000 7feb327a1640 10 monclient: shutdown 2024-09-11T01:58:29.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.638+0000 7feb327a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:29.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.638+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 >> v1:172.21.15.73:6790/0 conn(0x7feb2c0a5a30 legacy=0x7feb2c134810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.638+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 shutdown_connections 2024-09-11T01:58:29.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.638+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 >> 172.21.15.73:0/1695822879 conn(0x7feb2c0a7b30 msgr2=0x7feb2c132dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:29.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.638+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 shutdown_connections 2024-09-11T01:58:29.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.638+0000 7feb327a1640 1 -- 172.21.15.73:0/1695822879 wait complete. 2024-09-11T01:58:29.650 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6812","nonce":2311533528}]},"active_addr":"172.21.15.203:6812/2311533528","active_change":"2024-09-11T01:58:12.869615+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":2437120501}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":2197008230}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":1178549083}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":2098111342}]}]} 2024-09-11T01:58:29.652 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T01:58:29.652 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T01:58:29.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T01:58:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.747+0000 7fc6789c2640 10 monclient: get_monmap_and_config 2024-09-11T01:58:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.747+0000 7fc6789c2640 10 monclient: build_initial_monmap 2024-09-11T01:58:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.747+0000 7fc6789c2640 10 monclient: monmap: 2024-09-11T01:58:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:29.748499+0000 2024-09-11T01:58:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:29.748499+0000 2024-09-11T01:58:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:29.750 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 1 Processor -- start 2024-09-11T01:58:29.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 1 -- start start 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 10 monclient: init 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 10 monclient: _add_conns ranks=[5,4,1,8,0,6,2,7,3] 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 10 monclient(hunting): picked mon.noname-h con 0x7fc6740a5ba0 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 10 monclient(hunting): picked mon.noname-c con 0x7fc67409db00 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 10 monclient(hunting): picked mon.noname-f con 0x7fc6740a6690 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6740a7a50 con 0x7fc6740a6690 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67406fb30 con 0x7fc67409db00 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc67409ce40 con 0x7fc6740a5ba0 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.748+0000 7fc6789c2640 10 monclient(hunting): authenticate will time out at 751.352989s 2024-09-11T01:58:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc671d9b640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fc67409db00 0x7fc67413ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51860/0 (socket says 172.21.15.73:51860) 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc671d9b640 1 -- 172.21.15.73:0/1145927036 learned_addr learned my addr 172.21.15.73:0/1145927036 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613991932 0 0) 0x7fc67406fb30 con 0x7fc67409db00 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): my global_id is 4297 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc65c003520 con 0x7fc67409db00 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089521755 0 0) 0x7fc67409ce40 con 0x7fc6740a5ba0 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): my global_id is 4307 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc67406fb30 con 0x7fc6740a5ba0 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243964751 0 0) 0x7fc6740a7a50 con 0x7fc6740a6690 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient(hunting): my global_id is 4249 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc67409ce40 con 0x7fc6740a6690 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 39697343 0 0) 0x7fc65c003520 con 0x7fc67409db00 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 >> v1:172.21.15.203:6791/0 conn(0x7fc6740a5ba0 legacy=0x7fc6740a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 >> v1:172.21.15.203:6789/0 conn(0x7fc6740a6690 legacy=0x7fc6741414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: _finish_hunting 0 2024-09-11T01:58:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 monclient: found mon.noname-c 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6740a7440 con 0x7fc67409db00 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: _finish_auth 0 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: _check_auth_tickets 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc668001830 con 0x7fc67409db00 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: dump: 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.762 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc6789c2640 5 monclient: authenticate success, global_id 4297 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc6789c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc668001a50 con 0x7fc67409db00 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 1 -- 172.21.15.73:0/1145927036 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc668004be0 con 0x7fc67409db00 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc6789c2640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc6789c2640 4 set_mon_vals no callback set 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.749+0000 7fc67159a640 10 monclient: dump: 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.750+0000 7fc6789c2640 10 monclient: shutdown 2024-09-11T01:58:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.750+0000 7fc6789c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.750+0000 7fc6789c2640 1 -- 172.21.15.73:0/1145927036 >> v1:172.21.15.73:6791/0 conn(0x7fc67409db00 legacy=0x7fc67413ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.750+0000 7fc6789c2640 1 -- 172.21.15.73:0/1145927036 shutdown_connections 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.750+0000 7fc6789c2640 1 -- 172.21.15.73:0/1145927036 >> 172.21.15.73:0/1145927036 conn(0x7fc6740a7e80 msgr2=0x7fc6740a8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.750+0000 7fc6789c2640 1 -- 172.21.15.73:0/1145927036 shutdown_connections 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.750+0000 7fc6789c2640 1 -- 172.21.15.73:0/1145927036 wait complete. 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.750+0000 7fc6789c2640 10 monclient: build_initial_monmap 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 10 monclient: monmap: 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 1 Processor -- start 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 1 -- start start 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 10 monclient: init 2024-09-11T01:58:29.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 10 monclient: _add_conns ranks=[3,7,0,1,8,6,5,2,4] 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 10 monclient(hunting): picked mon.noname-g con 0x7fc67409db00 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 10 monclient(hunting): picked mon.noname-i con 0x7fc6740a5ba0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 10 monclient(hunting): picked mon.noname-a con 0x7fc6740a6690 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc674124130 con 0x7fc6740a6690 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6740a1db0 con 0x7fc67409db00 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc674125bf0 con 0x7fc6740a5ba0 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc6789c2640 10 monclient(hunting): authenticate will time out at 751.355851s 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc672d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc6740a6690 0x7fc6741d5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39802/0 (socket says 172.21.15.73:39802) 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.751+0000 7fc672d9d640 1 -- 172.21.15.73:0/3837325778 learned_addr learned my addr 172.21.15.73:0/3837325778 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80341438 0 0) 0x7fc674124130 con 0x7fc6740a6690 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): my global_id is 4284 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc654003520 con 0x7fc6740a6690 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668126863 0 0) 0x7fc674125bf0 con 0x7fc6740a5ba0 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): my global_id is 4210 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc674124130 con 0x7fc6740a5ba0 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 730034594 0 0) 0x7fc6740a1db0 con 0x7fc67409db00 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): my global_id is 4287 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc674125bf0 con 0x7fc67409db00 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2275395873 0 0) 0x7fc654003520 con 0x7fc6740a6690 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6740a1db0 con 0x7fc6740a6690 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc66c001e30 con 0x7fc6740a6690 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3354248494 0 0) 0x7fc6740a1db0 con 0x7fc6740a6690 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 >> v1:172.21.15.203:6792/0 conn(0x7fc6740a5ba0 legacy=0x7fc674138ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 >> v1:172.21.15.203:6790/0 conn(0x7fc67409db00 legacy=0x7fc674122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 monclient: found mon.a 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6741391e0 con 0x7fc6740a6690 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc6789c2640 5 monclient: authenticate success, global_id 4284 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc6789c2640 10 monclient: _renew_subs 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc6789c2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:29.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc674139470 con 0x7fc6740a6690 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc6789c2640 10 monclient: _renew_subs 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc6789c2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc674124e70 con 0x7fc6740a6690 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc66c003c40 con 0x7fc6740a6690 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc66c004230 con 0x7fc6740a6690 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc670d99640 4 set_mon_vals no callback set 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.752+0000 7fc662ffd640 10 monclient: dump: 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:29.773 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:29.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.753+0000 7fc6789c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:29.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.753+0000 7fc6789c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:29.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.753+0000 7fc6789c2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:29.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.753+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc658005080 con 0x7fc6740a6690 2024-09-11T01:58:29.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.753+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fc66c0043d0 con 0x7fc6740a6690 2024-09-11T01:58:29.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.754+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7fc66c04e480 con 0x7fc6740a6690 2024-09-11T01:58:29.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.754+0000 7fc67259c640 10 monclient: get_auth_request con 0x7fc65403fed0 auth_method 0 2024-09-11T01:58:29.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.758+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fc66c017940 con 0x7fc6740a6690 2024-09-11T01:58:29.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.758+0000 7fc662ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:29.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.758+0000 7fc662ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.932+0000 7fc6789c2640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.932+0000 7fc6789c2640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.932+0000 7fc6789c2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.932+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc658005370 con 0x7fc6740a6690 2024-09-11T01:58:29.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.933+0000 7fc662ffd640 1 -- 172.21.15.73:0/3837325778 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10953 (unknown 3413328019 0 1863115583) 0x7fc66c017240 con 0x7fc6740a6690 2024-09-11T01:58:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.933+0000 7fc662ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:29.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.933+0000 7fc662ffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:29.935 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:29.935 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","created":"2024-09-11T01:58:08.604820+0000","modified":"2024-09-11T01:58:28.982822+0000","last_up_change":"2024-09-11T01:58:19.924468+0000","last_in_change":"2024-09-11T01:58:10.229533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:58:20.893945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T01:58:25.343535+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ed1d0ce-ed57-4eed-b684-5c04e84a8405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":3691603832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":3691603832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":3691603832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":3691603832}]},"public_addr":"172.21.15.73:6804/3691603832","cluster_addr":"172.21.15.73:6805/3691603832","heartbeat_back_addr":"172.21.15.73:6807/3691603832","heartbeat_front_addr":"172.21.15.73:6806/3691603832","state":["exists","up"]},{"osd":1,"uuid":"3aa077b3-74c6-4609-8587-8a3c5ec8bc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":2131770571}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":2131770571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":2131770571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":2131770571}]},"public_addr":"172.21.15.73:6800/2131770571","cluster_addr":"172.21.15.73:6801/2131770571","heartbeat_back_addr":"172.21.15.73:6803/2131770571","heartbeat_front_addr":"172.21.15.73:6802/2131770571","state":["exists","up"]},{"osd":2,"uuid":"063c664b-ce58-42bd-bd80-0d6b9721fcb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":2154209098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":2154209098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":2154209098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":2154209098}]},"public_addr":"172.21.15.73:6808/2154209098","cluster_addr":"172.21.15.73:6809/2154209098","heartbeat_back_addr":"172.21.15.73:6811/2154209098","heartbeat_front_addr":"172.21.15.73:6810/2154209098","state":["exists","up"]},{"osd":3,"uuid":"12d01ea7-7a0e-4b5a-ac25-a6ba6af66458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6808","nonce":1861196202}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6809","nonce":1861196202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6811","nonce":1861196202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6810","nonce":1861196202}]},"public_addr":"172.21.15.203:6808/1861196202","cluster_addr":"172.21.15.203:6809/1861196202","heartbeat_back_addr":"172.21.15.203:6811/1861196202","heartbeat_front_addr":"172.21.15.203:6810/1861196202","state":["exists","up"]},{"osd":4,"uuid":"8b89af16-5602-4527-ba2c-b7142acac9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6804","nonce":1562443458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6805","nonce":1562443458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6807","nonce":1562443458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6806","nonce":1562443458}]},"public_addr":"172.21.15.203:6804/1562443458","cluster_addr":"172.21.15.203:6805/1562443458","heartbeat_back_addr":"172.21.15.203:6807/1562443458","heartbeat_front_addr":"172.21.15.203:6806/1562443458","state":["exists","up"]},{"osd":5,"uuid":"ae991c5c-eac0-4bd2-8d87-7efa36a62abb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6800","nonce":464336651}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6801","nonce":464336651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6803","nonce":464336651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6802","nonce":464336651}]},"public_addr":"172.21.15.203:6800/464336651","cluster_addr":"172.21.15.203:6801/464336651","heartbeat_back_addr":"172.21.15.203:6803/464336651","heartbeat_front_addr":"172.21.15.203:6802/464336651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.395799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.286329+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.691165+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.965210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.767253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.540222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:58:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.935+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 >> v1:172.21.15.203:6812/2311533528 conn(0x7fc65403fed0 legacy=0x7fc654042390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.935+0000 7fc6789c2640 10 monclient: shutdown 2024-09-11T01:58:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.935+0000 7fc6789c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.935+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 >> v1:172.21.15.73:6789/0 conn(0x7fc6740a6690 legacy=0x7fc6741d5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.935+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 shutdown_connections 2024-09-11T01:58:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.935+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 >> 172.21.15.73:0/3837325778 conn(0x7fc6740a7e80 msgr2=0x7fc6740a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.935+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 shutdown_connections 2024-09-11T01:58:29.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:29.935+0000 7fc6789c2640 1 -- 172.21.15.73:0/3837325778 wait complete. 2024-09-11T01:58:29.947 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T01:58:29.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T01:58:30.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.044+0000 7feaecb84640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.044+0000 7feaecb84640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.044+0000 7feaecb84640 10 monclient: monmap: 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.045148+0000 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.045148+0000 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.046 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.047 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.047 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.044+0000 7feaecb84640 1 Processor -- start 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.044+0000 7feaecb84640 1 -- start start 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.044+0000 7feaecb84640 10 monclient: init 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 10 monclient: _add_conns ranks=[3,1,0,8,2,6,7,4,5] 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 10 monclient(hunting): picked mon.noname-g con 0x7feae8138960 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 10 monclient(hunting): picked mon.noname-f con 0x7feae8139450 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 10 monclient(hunting): picked mon.noname-a con 0x7feae813f620 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae809d030 con 0x7feae813f620 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae809d310 con 0x7feae8139450 2024-09-11T01:58:30.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae806f770 con 0x7feae8138960 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feaecb84640 10 monclient(hunting): authenticate will time out at 751.649561s 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feae6d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feae813f620 0x7feae8141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39816/0 (socket says 172.21.15.73:39816) 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feae6d9d640 1 -- 172.21.15.73:0/535025190 learned_addr learned my addr 172.21.15.73:0/535025190 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feae559a640 1 -- 172.21.15.73:0/535025190 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128124892 0 0) 0x7feae809d030 con 0x7feae813f620 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feae559a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feae559a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feae559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feae559a640 10 monclient(hunting): my global_id is 4293 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.045+0000 7feae559a640 1 -- 172.21.15.73:0/535025190 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead4003520 con 0x7feae813f620 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 1 -- 172.21.15.73:0/535025190 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1482749492 0 0) 0x7fead4003520 con 0x7feae813f620 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 1 -- 172.21.15.73:0/535025190 >> v1:172.21.15.203:6790/0 conn(0x7feae8138960 legacy=0x7feae8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:58:30.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 1 -- 172.21.15.73:0/535025190 >> v1:172.21.15.203:6789/0 conn(0x7feae8139450 legacy=0x7feae813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 1 monclient: found mon.noname-a 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 1 -- 172.21.15.73:0/535025190 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae80a7360 con 0x7feae813f620 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 1 -- 172.21.15.73:0/535025190 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feae0001bb0 con 0x7feae813f620 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 5 monclient: authenticate success, global_id 4293 2024-09-11T01:58:30.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: dump: 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.058 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 1 -- 172.21.15.73:0/535025190 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feae0001e50 con 0x7feae813f620 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 1 -- 172.21.15.73:0/535025190 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feae0004f60 con 0x7feae813f620 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 4 set_mon_vals no callback set 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feae559a640 10 monclient: dump: 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.060 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 10 monclient: shutdown 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 1 -- 172.21.15.73:0/535025190 >> v1:172.21.15.73:6789/0 conn(0x7feae813f620 legacy=0x7feae8141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 1 -- 172.21.15.73:0/535025190 shutdown_connections 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 1 -- 172.21.15.73:0/535025190 >> 172.21.15.73:0/535025190 conn(0x7feae80a8050 msgr2=0x7feae80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 1 -- 172.21.15.73:0/535025190 shutdown_connections 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.046+0000 7feaecb84640 1 -- 172.21.15.73:0/535025190 wait complete. 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.047+0000 7feaecb84640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.047+0000 7feaecb84640 10 monclient: monmap: 2024-09-11T01:58:30.061 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.062 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.047+0000 7feaecb84640 1 Processor -- start 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.047+0000 7feaecb84640 1 -- start start 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.047+0000 7feaecb84640 10 monclient: init 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 10 monclient: _add_conns ranks=[0,7,6,4,8,1,5,2,3] 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 10 monclient(hunting): picked mon.noname-a con 0x7feae8138960 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 10 monclient(hunting): picked mon.noname-i con 0x7feae8139450 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 10 monclient(hunting): picked mon.noname-d con 0x7feae813f620 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae80a5070 con 0x7feae8138960 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae813ee90 con 0x7feae813f620 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae813c100 con 0x7feae8139450 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feaecb84640 10 monclient(hunting): authenticate will time out at 751.652400s 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feae659c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feae8138960 0x7feae8137d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39832/0 (socket says 172.21.15.73:39832) 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feae659c640 1 -- 172.21.15.73:0/1108865320 learned_addr learned my addr 172.21.15.73:0/1108865320 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1967101173 0 0) 0x7feae80a5070 con 0x7feae8138960 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): my global_id is 4302 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feac8003520 con 0x7feae8138960 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005819209 0 0) 0x7feae813ee90 con 0x7feae813f620 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): my global_id is 4236 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae80a5070 con 0x7feae813f620 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859348691 0 0) 0x7feae813c100 con 0x7feae8139450 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): my global_id is 4219 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae813ee90 con 0x7feae8139450 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3652528030 0 0) 0x7feac8003520 con 0x7feae8138960 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feae813c100 con 0x7feae8138960 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fead0004220 con 0x7feae8138960 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): dump: 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1097622918 0 0) 0x7feae80a5070 con 0x7feae813f620 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feac8003520 con 0x7feae813f620 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feae0001360 con 0x7feae813f620 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.048+0000 7feadeffd640 10 monclient(hunting): dump: 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.067 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3662053841 0 0) 0x7feae813c100 con 0x7feae8138960 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 >> v1:172.21.15.203:6792/0 conn(0x7feae8139450 legacy=0x7feae81d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 >> v1:172.21.15.73:6792/0 conn(0x7feae813f620 legacy=0x7feae81d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 1 monclient: found mon.a 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae813c3e0 con 0x7feae8138960 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feaecb84640 5 monclient: authenticate success, global_id 4302 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feaecb84640 10 monclient: _renew_subs 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feaecb84640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feae813d380 con 0x7feae8138960 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feaecb84640 10 monclient: _renew_subs 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feaecb84640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feae813b1a0 con 0x7feae8138960 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fead0001180 con 0x7feae8138960 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fead00016b0 con 0x7feae8138960 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feae4d99640 4 set_mon_vals no callback set 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.049+0000 7feadeffd640 10 monclient: dump: 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.070 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.071 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.072 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.050+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fead0001850 con 0x7feae8138960 2024-09-11T01:58:30.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.050+0000 7feaecb84640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.050+0000 7feaecb84640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.050+0000 7feaecb84640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.050+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feacc005080 con 0x7feae8138960 2024-09-11T01:58:30.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.050+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7fead004e290 con 0x7feae8138960 2024-09-11T01:58:30.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.050+0000 7feae5d9b640 10 monclient: get_auth_request con 0x7feac8040460 auth_method 0 2024-09-11T01:58:30.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.054+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fead00175c0 con 0x7feae8138960 2024-09-11T01:58:30.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.054+0000 7feadeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.054+0000 7feadeffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.229+0000 7feaecb84640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.229+0000 7feaecb84640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.229+0000 7feaecb84640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.229+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feacc005370 con 0x7feae8138960 2024-09-11T01:58:30.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.230+0000 7feadeffd640 1 -- 172.21.15.73:0/1108865320 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10953 (unknown 3413328019 0 1863115583) 0x7fead001b9a0 con 0x7feae8138960 2024-09-11T01:58:30.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.230+0000 7feadeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:30.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.230+0000 7feadeffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:30.232 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:30.233 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","created":"2024-09-11T01:58:08.604820+0000","modified":"2024-09-11T01:58:28.982822+0000","last_up_change":"2024-09-11T01:58:19.924468+0000","last_in_change":"2024-09-11T01:58:10.229533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:58:20.893945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T01:58:25.343535+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ed1d0ce-ed57-4eed-b684-5c04e84a8405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":3691603832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":3691603832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":3691603832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":3691603832}]},"public_addr":"172.21.15.73:6804/3691603832","cluster_addr":"172.21.15.73:6805/3691603832","heartbeat_back_addr":"172.21.15.73:6807/3691603832","heartbeat_front_addr":"172.21.15.73:6806/3691603832","state":["exists","up"]},{"osd":1,"uuid":"3aa077b3-74c6-4609-8587-8a3c5ec8bc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":2131770571}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":2131770571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":2131770571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":2131770571}]},"public_addr":"172.21.15.73:6800/2131770571","cluster_addr":"172.21.15.73:6801/2131770571","heartbeat_back_addr":"172.21.15.73:6803/2131770571","heartbeat_front_addr":"172.21.15.73:6802/2131770571","state":["exists","up"]},{"osd":2,"uuid":"063c664b-ce58-42bd-bd80-0d6b9721fcb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":2154209098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":2154209098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":2154209098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":2154209098}]},"public_addr":"172.21.15.73:6808/2154209098","cluster_addr":"172.21.15.73:6809/2154209098","heartbeat_back_addr":"172.21.15.73:6811/2154209098","heartbeat_front_addr":"172.21.15.73:6810/2154209098","state":["exists","up"]},{"osd":3,"uuid":"12d01ea7-7a0e-4b5a-ac25-a6ba6af66458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6808","nonce":1861196202}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6809","nonce":1861196202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6811","nonce":1861196202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6810","nonce":1861196202}]},"public_addr":"172.21.15.203:6808/1861196202","cluster_addr":"172.21.15.203:6809/1861196202","heartbeat_back_addr":"172.21.15.203:6811/1861196202","heartbeat_front_addr":"172.21.15.203:6810/1861196202","state":["exists","up"]},{"osd":4,"uuid":"8b89af16-5602-4527-ba2c-b7142acac9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6804","nonce":1562443458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6805","nonce":1562443458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6807","nonce":1562443458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6806","nonce":1562443458}]},"public_addr":"172.21.15.203:6804/1562443458","cluster_addr":"172.21.15.203:6805/1562443458","heartbeat_back_addr":"172.21.15.203:6807/1562443458","heartbeat_front_addr":"172.21.15.203:6806/1562443458","state":["exists","up"]},{"osd":5,"uuid":"ae991c5c-eac0-4bd2-8d87-7efa36a62abb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6800","nonce":464336651}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6801","nonce":464336651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6803","nonce":464336651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6802","nonce":464336651}]},"public_addr":"172.21.15.203:6800/464336651","cluster_addr":"172.21.15.203:6801/464336651","heartbeat_back_addr":"172.21.15.203:6803/464336651","heartbeat_front_addr":"172.21.15.203:6802/464336651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.395799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.286329+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.691165+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.965210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.767253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.540222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:58:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.232+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 >> v1:172.21.15.203:6812/2311533528 conn(0x7feac8040460 legacy=0x7feac8042920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.232+0000 7feaecb84640 10 monclient: shutdown 2024-09-11T01:58:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.232+0000 7feaecb84640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.232+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 >> v1:172.21.15.73:6789/0 conn(0x7feae8138960 legacy=0x7feae8137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.232+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 shutdown_connections 2024-09-11T01:58:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.232+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 >> 172.21.15.73:0/1108865320 conn(0x7feae80a8050 msgr2=0x7feae8141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.232+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 shutdown_connections 2024-09-11T01:58:30.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.232+0000 7feaecb84640 1 -- 172.21.15.73:0/1108865320 wait complete. 2024-09-11T01:58:30.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T01:58:30.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T01:58:30.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T01:58:30.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T01:58:30.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T01:58:30.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T01:58:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.355+0000 7f238de33640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.355+0000 7f51318c6640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.355+0000 7f238de33640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.355+0000 7f238de33640 10 monclient: monmap: 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.356560+0000 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.356560+0000 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.359 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.355+0000 7f51318c6640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.355+0000 7f51318c6640 10 monclient: monmap: 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.356726+0000 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.356726+0000 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.360 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.361 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.361 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.361 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.361 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.361 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.356+0000 7f238de33640 1 Processor -- start 2024-09-11T01:58:30.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.356+0000 7f238de33640 1 -- start start 2024-09-11T01:58:30.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.356+0000 7f238de33640 10 monclient: init 2024-09-11T01:58:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.356+0000 7f51318c6640 1 Processor -- start 2024-09-11T01:58:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.356+0000 7f51318c6640 1 -- start start 2024-09-11T01:58:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.356+0000 7f51318c6640 10 monclient: init 2024-09-11T01:58:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 10 monclient: _add_conns ranks=[7,2,8,6,5,4,1,3,0] 2024-09-11T01:58:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 10 monclient(hunting): picked mon.noname-i con 0x7f2388138960 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 10 monclient: _add_conns ranks=[7,2,4,0,3,8,6,5,1] 2024-09-11T01:58:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 10 monclient(hunting): picked mon.noname-i con 0x7f512c138960 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 10 monclient(hunting): picked mon.noname-b con 0x7f512c139450 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 10 monclient(hunting): picked mon.noname-c con 0x7f512c13f620 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 10 monclient(hunting): picked mon.noname-b con 0x7f2388139450 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 10 monclient(hunting): picked mon.noname-e con 0x7f238813f620 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238809d030 con 0x7f2388139450 2024-09-11T01:58:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238809d310 con 0x7f2388138960 2024-09-11T01:58:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238806f770 con 0x7f238813f620 2024-09-11T01:58:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f238de33640 10 monclient(hunting): authenticate will time out at 751.961690s 2024-09-11T01:58:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c09d030 con 0x7f512c139450 2024-09-11T01:58:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c09d310 con 0x7f512c13f620 2024-09-11T01:58:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c06f770 con 0x7f512c138960 2024-09-11T01:58:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f2386ffd640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f2388139450 0x7f238813df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41042/0 (socket says 172.21.15.73:41042) 2024-09-11T01:58:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f51318c6640 10 monclient(hunting): authenticate will time out at 751.961434s 2024-09-11T01:58:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f5123fff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f512c139450 0x7f512c13df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41044/0 (socket says 172.21.15.73:41044) 2024-09-11T01:58:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f5123fff640 1 -- 172.21.15.73:0/3639773432 learned_addr learned my addr 172.21.15.73:0/3639773432 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f2386ffd640 1 -- 172.21.15.73:0/1742270776 learned_addr learned my addr 172.21.15.73:0/1742270776 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.357+0000 7f23877fe640 1 --1- 172.21.15.73:0/1742270776 >> v1:172.21.15.203:6792/0 conn(0x7f2388138960 0x7f2388138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6792/0 says I am v1:172.21.15.73:51668/0 (socket says 172.21.15.73:51668) 2024-09-11T01:58:30.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491563012 0 0) 0x7f512c09d310 con 0x7f512c13f620 2024-09-11T01:58:30.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient(hunting): my global_id is 4306 2024-09-11T01:58:30.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5118003520 con 0x7f512c13f620 2024-09-11T01:58:30.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124402899 0 0) 0x7f512c09d030 con 0x7f512c139450 2024-09-11T01:58:30.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient(hunting): my global_id is 4259 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f512c09d310 con 0x7f512c139450 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007763704 0 0) 0x7f238809d310 con 0x7f2388138960 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): my global_id is 4228 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2370003520 con 0x7f2388138960 2024-09-11T01:58:30.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766971310 0 0) 0x7f238809d030 con 0x7f2388139450 2024-09-11T01:58:30.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): my global_id is 4268 2024-09-11T01:58:30.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2370003880 con 0x7f2388139450 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4170865222 0 0) 0x7f5118003520 con 0x7f512c13f620 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 >> v1:172.21.15.203:6792/0 conn(0x7f512c138960 legacy=0x7f512c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 >> v1:172.21.15.73:6790/0 conn(0x7f512c139450 legacy=0x7f512c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 monclient: found mon.noname-c 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c0a7360 con 0x7f512c13f620 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5124001bb0 con 0x7f512c13f620 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f512a7fc640 10 monclient: dump: 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.372 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.373 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.373 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.373 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.373 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.373 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.373 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f51318c6640 5 monclient: authenticate success, global_id 4306 2024-09-11T01:58:30.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f51318c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1695667750 0 0) 0x7f238806f770 con 0x7f238813f620 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient(hunting): my global_id is 4247 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f238809d030 con 0x7f238813f620 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1266345040 0 0) 0x7f2370003520 con 0x7f2388138960 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 >> v1:172.21.15.73:6793/0 conn(0x7f238813f620 legacy=0x7f2388141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 >> v1:172.21.15.73:6790/0 conn(0x7f2388139450 legacy=0x7f238813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 monclient: found mon.noname-i 2024-09-11T01:58:30.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.203:6792/0 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 --> v1:172.21.15.203:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23880a7360 con 0x7f2388138960 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2378001790 con 0x7f2388138960 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.358+0000 7f23867fc640 10 monclient: dump: 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.375 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f238de33640 5 monclient: authenticate success, global_id 4228 2024-09-11T01:58:30.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f238de33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5124001d50 con 0x7f512c13f620 2024-09-11T01:58:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f512a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f512a7fc640 1 -- 172.21.15.73:0/3639773432 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5124003cb0 con 0x7f512c13f620 2024-09-11T01:58:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f512a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f512a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f512a7fc640 10 monclient: dump: 2024-09-11T01:58:30.377 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.378 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f51318c6640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f51318c6640 4 set_mon_vals no callback set 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 <== mon.7 v1:172.21.15.203:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2378001930 con 0x7f2388138960 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f23867fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f238de33640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f238de33640 4 set_mon_vals no callback set 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f23867fc640 1 -- 172.21.15.73:0/1742270776 <== mon.7 v1:172.21.15.203:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2378001be0 con 0x7f2388138960 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f23867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f23867fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.359+0000 7f23867fc640 10 monclient: dump: 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.380 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.381 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f51318c6640 10 monclient: shutdown 2024-09-11T01:58:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f51318c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f51318c6640 1 -- 172.21.15.73:0/3639773432 >> v1:172.21.15.73:6791/0 conn(0x7f512c13f620 legacy=0x7f512c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f238de33640 10 monclient: shutdown 2024-09-11T01:58:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f238de33640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f238de33640 1 -- 172.21.15.73:0/1742270776 >> v1:172.21.15.203:6792/0 conn(0x7f2388138960 legacy=0x7f2388138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f51318c6640 1 -- 172.21.15.73:0/3639773432 shutdown_connections 2024-09-11T01:58:30.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f51318c6640 1 -- 172.21.15.73:0/3639773432 >> 172.21.15.73:0/3639773432 conn(0x7f512c0a8050 msgr2=0x7f512c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f238de33640 1 -- 172.21.15.73:0/1742270776 shutdown_connections 2024-09-11T01:58:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f238de33640 1 -- 172.21.15.73:0/1742270776 >> 172.21.15.73:0/1742270776 conn(0x7f23880a8050 msgr2=0x7f23880a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f51318c6640 1 -- 172.21.15.73:0/3639773432 shutdown_connections 2024-09-11T01:58:30.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f51318c6640 1 -- 172.21.15.73:0/3639773432 wait complete. 2024-09-11T01:58:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f238de33640 1 -- 172.21.15.73:0/1742270776 shutdown_connections 2024-09-11T01:58:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f238de33640 1 -- 172.21.15.73:0/1742270776 wait complete. 2024-09-11T01:58:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f238de33640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.360+0000 7f238de33640 10 monclient: monmap: 2024-09-11T01:58:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.384 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.385 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f51318c6640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f51318c6640 10 monclient: monmap: 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.386 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.387 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.387 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.387 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.387 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.387 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.387 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.387 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f238de33640 1 Processor -- start 2024-09-11T01:58:30.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f51318c6640 1 Processor -- start 2024-09-11T01:58:30.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f51318c6640 1 -- start start 2024-09-11T01:58:30.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f238de33640 1 -- start start 2024-09-11T01:58:30.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f238de33640 10 monclient: init 2024-09-11T01:58:30.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f51318c6640 10 monclient: init 2024-09-11T01:58:30.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f238de33640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f238de33640 10 monclient: _add_conns ranks=[6,0,2,4,5,3,7,1,8] 2024-09-11T01:58:30.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f238de33640 10 monclient(hunting): picked mon.noname-d con 0x7f2388138960 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f51318c6640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.361+0000 7f51318c6640 10 monclient: _add_conns ranks=[1,7,3,6,4,0,2,5,8] 2024-09-11T01:58:30.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f51318c6640 10 monclient(hunting): picked mon.noname-f con 0x7f512c138960 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:30.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f51318c6640 10 monclient(hunting): picked mon.noname-i con 0x7f512c139450 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f238de33640 10 monclient(hunting): picked mon.noname-a con 0x7f2388139450 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f238de33640 10 monclient(hunting): picked mon.noname-b con 0x7f238813f620 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:30.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f238de33640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238813c7a0 con 0x7f2388139450 2024-09-11T01:58:30.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f238de33640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238813f340 con 0x7f238813f620 2024-09-11T01:58:30.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f238de33640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238813e990 con 0x7f2388138960 2024-09-11T01:58:30.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f238de33640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f238de33640 10 monclient(hunting): authenticate will time out at 751.966196s 2024-09-11T01:58:30.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f51318c6640 10 monclient(hunting): picked mon.noname-g con 0x7f512c13f620 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:30.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f51318c6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c0a1af0 con 0x7f512c138960 2024-09-11T01:58:30.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f51318c6640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c13eec0 con 0x7f512c13f620 2024-09-11T01:58:30.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f51318c6640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512c13f310 con 0x7f512c139450 2024-09-11T01:58:30.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f51318c6640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f51318c6640 10 monclient(hunting): authenticate will time out at 751.966294s 2024-09-11T01:58:30.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f23877fe640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f2388138960 0x7f2388137ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:38106/0 (socket says 172.21.15.73:38106) 2024-09-11T01:58:30.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f5123fff640 1 --1- >> v1:172.21.15.203:6792/0 conn(0x7f512c139450 0x7f512c1d2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6792/0 says I am v1:172.21.15.73:51698/0 (socket says 172.21.15.73:51698) 2024-09-11T01:58:30.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f5123fff640 1 -- 172.21.15.73:0/1103902403 learned_addr learned my addr 172.21.15.73:0/1103902403 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f512affd640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f512c138960 0x7f512c13e360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.73:54252/0 (socket says 172.21.15.73:54252) 2024-09-11T01:58:30.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f23877fe640 1 -- 172.21.15.73:0/3830369094 learned_addr learned my addr 172.21.15.73:0/3830369094 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840824817 0 0) 0x7f512c0a1af0 con 0x7f512c138960 2024-09-11T01:58:30.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f5128ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200849803 0 0) 0x7f238813c7a0 con 0x7f2388139450 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): my global_id is 4311 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2374003520 con 0x7f2388139450 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517809830 0 0) 0x7f238813e990 con 0x7f2388138960 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): my global_id is 4245 2024-09-11T01:58:30.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f238813c7a0 con 0x7f2388138960 2024-09-11T01:58:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f5128ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f5128ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): my global_id is 4258 2024-09-11T01:58:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997086275 0 0) 0x7f238813f340 con 0x7f238813f620 2024-09-11T01:58:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 10 monclient(hunting): my global_id is 4277 2024-09-11T01:58:30.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.362+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f238813e990 con 0x7f238813f620 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f510c003520 con 0x7f512c138960 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160123067 0 0) 0x7f512c13f310 con 0x7f512c139450 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): my global_id is 4246 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f512c0a1af0 con 0x7f512c139450 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574612111 0 0) 0x7f512c13eec0 con 0x7f512c13f620 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): my global_id is 4296 2024-09-11T01:58:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f512c13f310 con 0x7f512c13f620 2024-09-11T01:58:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4015280844 0 0) 0x7f510c003520 con 0x7f512c138960 2024-09-11T01:58:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f512c13eec0 con 0x7f512c138960 2024-09-11T01:58:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3031645489 0 0) 0x7f238813c7a0 con 0x7f2388138960 2024-09-11T01:58:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f238813f340 con 0x7f2388138960 2024-09-11T01:58:30.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2378001be0 con 0x7f2388138960 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): dump: 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.399 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3440468514 0 0) 0x7f2374003520 con 0x7f2388139450 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f238813c7a0 con 0x7f2388139450 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1404565371 0 0) 0x7f238813e990 con 0x7f238813f620 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2374003520 con 0x7f238813f620 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f237c001550 con 0x7f2388139450 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): dump: 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.401 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2380001b30 con 0x7f238813f620 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient(hunting): dump: 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.402 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.403 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.403 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f511c001a50 con 0x7f512c138960 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.404 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.405 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 359246080 0 0) 0x7f238813c7a0 con 0x7f2388139450 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 >> v1:172.21.15.73:6792/0 conn(0x7f2388138960 legacy=0x7f2388137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 >> v1:172.21.15.73:6790/0 conn(0x7f238813f620 legacy=0x7f23881d5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 monclient: found mon.a 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2388142590 con 0x7f2388139450 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f236ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f238de33640 5 monclient: authenticate success, global_id 4311 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f238de33640 10 monclient: _renew_subs 2024-09-11T01:58:30.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f238de33640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f238813ef60 con 0x7f2388139450 2024-09-11T01:58:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1354376913 0 0) 0x7f512c0a1af0 con 0x7f512c139450 2024-09-11T01:58:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f510c003520 con 0x7f512c139450 2024-09-11T01:58:30.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3234730052 0 0) 0x7f512c13f310 con 0x7f512c13f620 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f512c0a1af0 con 0x7f512c13f620 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5114001b90 con 0x7f512c139450 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.408 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5124001af0 con 0x7f512c13f620 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:30.409 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.410 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 773259976 0 0) 0x7f512c13eec0 con 0x7f512c138960 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 >> v1:172.21.15.203:6792/0 conn(0x7f512c139450 legacy=0x7f512c1d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 >> v1:172.21.15.203:6790/0 conn(0x7f512c13f620 legacy=0x7f512c1d5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 1 monclient: found mon.f 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c13b4a0 con 0x7f512c138960 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f51318c6640 5 monclient: authenticate success, global_id 4258 2024-09-11T01:58:30.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f51318c6640 10 monclient: _renew_subs 2024-09-11T01:58:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f51318c6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f512c13c640 con 0x7f512c138960 2024-09-11T01:58:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f51318c6640 10 monclient: _renew_subs 2024-09-11T01:58:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f51318c6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f512c13ea70 con 0x7f512c138960 2024-09-11T01:58:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.1 v1:172.21.15.203:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f511c001d10 con 0x7f512c138960 2024-09-11T01:58:30.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5128ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f238de33640 10 monclient: _renew_subs 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f238de33640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.363+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2388141d50 con 0x7f2388139450 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f237c004a90 con 0x7f2388139450 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f236ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f237c004f80 con 0x7f2388139450 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f236ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f236ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f236ffff640 10 monclient: dump: 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.413 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.414 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f2385ffb640 4 set_mon_vals no callback set 2024-09-11T01:58:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f237c0116c0 con 0x7f2388139450 2024-09-11T01:58:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f238de33640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2368000f80 con 0x7f2388139450 2024-09-11T01:58:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.364+0000 7f5129ffb640 4 set_mon_vals no callback set 2024-09-11T01:58:30.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.1 v1:172.21.15.203:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f511c003c40 con 0x7f512c138960 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f5128ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f5128ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f5128ff9640 10 monclient: dump: 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.416 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.417 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.417 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.417 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.417 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.417 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.417 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.417 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f237c04e2f0 con 0x7f2388139450 2024-09-11T01:58:30.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.203:6808/1861196202 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f237404b020 con 0x7f2374047370 2024-09-11T01:58:30.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f237c04e700 con 0x7f2388139450 2024-09-11T01:58:30.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f236ffff640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-11T01:58:30.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.365+0000 7f23877fe640 10 monclient: get_auth_request con 0x7f2374040770 auth_method 0 2024-09-11T01:58:30.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f2387fff640 10 monclient: get_auth_request con 0x7f2374047370 auth_method 0 2024-09-11T01:58:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.1 v1:172.21.15.203:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f511c003ea0 con 0x7f512c138960 2024-09-11T01:58:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f51318c6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.203:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5110000f80 con 0x7f512c138960 2024-09-11T01:58:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.1 v1:172.21.15.203:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f511c04e250 con 0x7f512c138960 2024-09-11T01:58:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f5123fff640 10 monclient: get_auth_request con 0x7f510c040760 auth_method 0 2024-09-11T01:58:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.73:6800/2131770571 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f511c001d10 con 0x7f510c0472c0 2024-09-11T01:58:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== mon.1 v1:172.21.15.203:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f511c016bf0 con 0x7f512c138960 2024-09-11T01:58:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f5128ff9640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-11T01:58:30.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.366+0000 7f512b7fe640 10 monclient: get_auth_request con 0x7f510c0472c0 auth_method 0 2024-09-11T01:58:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.367+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== osd.3 v1:172.21.15.203:6808/1861196202 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f237404b020 con 0x7f2374047370 2024-09-11T01:58:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.367+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== osd.1 v1:172.21.15.73:6800/2131770571 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f511c001d10 con 0x7f510c0472c0 2024-09-11T01:58:30.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.380+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 --> v1:172.21.15.203:6808/1861196202 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2368002c70 con 0x7f2374047370 2024-09-11T01:58:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.381+0000 7f236ffff640 1 -- 172.21.15.73:0/3830369094 <== osd.3 v1:172.21.15.203:6808/1861196202 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3543570501) 0x7f2368002c70 con 0x7f2374047370 2024-09-11T01:58:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.381+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 --> v1:172.21.15.73:6800/2131770571 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5110002c70 con 0x7f510c0472c0 2024-09-11T01:58:30.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.381+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 >> v1:172.21.15.203:6808/1861196202 conn(0x7f2374047370 legacy=0x7f23740497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.381+0000 7f5128ff9640 1 -- 172.21.15.73:0/1103902403 <== osd.1 v1:172.21.15.73:6800/2131770571 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 654699149) 0x7f5110002c70 con 0x7f510c0472c0 2024-09-11T01:58:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.381+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 >> v1:172.21.15.203:6812/2311533528 conn(0x7f2374040770 legacy=0x7f2374042c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.381+0000 7f238de33640 10 monclient: shutdown 2024-09-11T01:58:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.381+0000 7f238de33640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.381+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 >> v1:172.21.15.73:6789/0 conn(0x7f2388139450 legacy=0x7f23881d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.381+0000 7f2387fff640 1 -- 172.21.15.73:0/3830369094 reap_dead start 2024-09-11T01:58:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 shutdown_connections 2024-09-11T01:58:30.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 >> v1:172.21.15.73:6800/2131770571 conn(0x7f510c0472c0 legacy=0x7f510c049700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 >> 172.21.15.73:0/3830369094 conn(0x7f23880a8050 msgr2=0x7f23880a10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 >> v1:172.21.15.203:6812/2311533528 conn(0x7f510c040760 legacy=0x7f510c042c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f51318c6640 10 monclient: shutdown 2024-09-11T01:58:30.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f51318c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 >> v1:172.21.15.203:6789/0 conn(0x7f512c138960 legacy=0x7f512c13e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f512b7fe640 1 -- 172.21.15.73:0/1103902403 reap_dead start 2024-09-11T01:58:30.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 shutdown_connections 2024-09-11T01:58:30.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f238de33640 1 -- 172.21.15.73:0/3830369094 wait complete. 2024-09-11T01:58:30.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 shutdown_connections 2024-09-11T01:58:30.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 >> 172.21.15.73:0/1103902403 conn(0x7f512c0a8050 msgr2=0x7f512c0a9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 shutdown_connections 2024-09-11T01:58:30.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.382+0000 7f51318c6640 1 -- 172.21.15.73:0/1103902403 wait complete. 2024-09-11T01:58:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:51539607557 2024-09-11T01:58:30.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T01:58:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2024-09-11T01:58:30.428 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T01:58:30.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.399+0000 7f03900b8640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.399+0000 7f03900b8640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.400+0000 7f03900b8640 10 monclient: monmap: 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.400849+0000 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.400849+0000 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.429 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.400+0000 7f03900b8640 1 Processor -- start 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.400+0000 7f03900b8640 1 -- start start 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.400+0000 7f03900b8640 10 monclient: init 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f07d132b640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f07d132b640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f07d132b640 10 monclient: monmap: 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.401953+0000 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.401953+0000 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.431 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.432 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 10 monclient: _add_conns ranks=[6,4,0,3,2,7,5,1,8] 2024-09-11T01:58:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 10 monclient(hunting): picked mon.noname-d con 0x7f0388138960 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 10 monclient(hunting): picked mon.noname-c con 0x7f0388139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 10 monclient(hunting): picked mon.noname-a con 0x7f038813f620 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038809d030 con 0x7f038813f620 2024-09-11T01:58:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038809d310 con 0x7f0388139450 2024-09-11T01:58:30.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038d653640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f0388139450 0x7f038813df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51886/0 (socket says 172.21.15.73:51886) 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038d653640 1 -- 172.21.15.73:0/4279959641 learned_addr learned my addr 172.21.15.73:0/4279959641 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 1 -- 172.21.15.73:0/4279959641 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038806f770 con 0x7f0388138960 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f03900b8640 10 monclient(hunting): authenticate will time out at 752.005663s 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613508280 0 0) 0x7f038809d310 con 0x7f0388139450 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): my global_id is 4315 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0374003520 con 0x7f0388139450 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803195515 0 0) 0x7f038806f770 con 0x7f0388138960 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): my global_id is 4254 2024-09-11T01:58:30.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f038809d310 con 0x7f0388138960 2024-09-11T01:58:30.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417055857 0 0) 0x7f038809d030 con 0x7f038813f620 2024-09-11T01:58:30.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f07d132b640 1 Processor -- start 2024-09-11T01:58:30.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 10 monclient(hunting): my global_id is 4320 2024-09-11T01:58:30.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.401+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f038806f770 con 0x7f038813f620 2024-09-11T01:58:30.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 1 -- start start 2024-09-11T01:58:30.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 10 monclient: init 2024-09-11T01:58:30.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1455691087 0 0) 0x7f038809d310 con 0x7f0388138960 2024-09-11T01:58:30.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 >> v1:172.21.15.73:6791/0 conn(0x7f0388139450 legacy=0x7f038813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 >> v1:172.21.15.73:6789/0 conn(0x7f038813f620 legacy=0x7f0388141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 1 monclient: found mon.noname-d 2024-09-11T01:58:30.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03880a7360 con 0x7f0388138960 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0384001810 con 0x7f0388138960 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: dump: 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.438 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f03900b8640 5 monclient: authenticate success, global_id 4254 2024-09-11T01:58:30.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f03900b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03840019b0 con 0x7f0388138960 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f03900b8640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 1 -- 172.21.15.73:0/4279959641 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0384003950 con 0x7f0388138960 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f03900b8640 4 set_mon_vals no callback set 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f038ce52640 10 monclient: dump: 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.440 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.441 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 10 monclient: _add_conns ranks=[3,8,6,0,5,7,4,1,2] 2024-09-11T01:58:30.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 10 monclient(hunting): picked mon.noname-g con 0x7f07cc0a23e0 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:30.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 10 monclient(hunting): picked mon.noname-e con 0x7f07cc0a1750 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:30.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 10 monclient(hunting): picked mon.noname-d con 0x7f07cc0a2ed0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc09a9f0 con 0x7f07cc0a23e0 2024-09-11T01:58:30.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc09fd60 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc0a0040 con 0x7f07cc0a1750 2024-09-11T01:58:30.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7fe4b911a640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7fe4b911a640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07d132b640 10 monclient(hunting): authenticate will time out at 752.006740s 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7fe4b911a640 10 monclient: monmap: 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.403577+0000 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.403577+0000 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.444 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.445 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.445 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.445 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.445 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.445 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07ca7fc640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f07cc0a1750 0x7f07cc1427c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38832/0 (socket says 172.21.15.73:38832) 2024-09-11T01:58:30.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.402+0000 7f07ca7fc640 1 -- 172.21.15.73:0/2335550239 learned_addr learned my addr 172.21.15.73:0/2335550239 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556804333 0 0) 0x7f07cc0a0040 con 0x7f07cc0a1750 2024-09-11T01:58:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): my global_id is 4256 2024-09-11T01:58:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07b4003520 con 0x7f07cc0a1750 2024-09-11T01:58:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f03900b8640 10 monclient: shutdown 2024-09-11T01:58:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f03900b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f03900b8640 1 -- 172.21.15.73:0/4279959641 >> v1:172.21.15.73:6792/0 conn(0x7f0388138960 legacy=0x7f0388138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787124024 0 0) 0x7f07cc09fd60 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): my global_id is 4263 2024-09-11T01:58:30.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07cc0a0040 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f03900b8640 1 -- 172.21.15.73:0/4279959641 shutdown_connections 2024-09-11T01:58:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293734274 0 0) 0x7f07cc09a9f0 con 0x7f07cc0a23e0 2024-09-11T01:58:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient(hunting): my global_id is 4305 2024-09-11T01:58:30.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f03900b8640 1 -- 172.21.15.73:0/4279959641 >> 172.21.15.73:0/4279959641 conn(0x7f03880a8050 msgr2=0x7f03880a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07cc09fd60 con 0x7f07cc0a23e0 2024-09-11T01:58:30.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4069238452 0 0) 0x7f07b4003520 con 0x7f07cc0a1750 2024-09-11T01:58:30.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 >> v1:172.21.15.73:6792/0 conn(0x7f07cc0a2ed0 legacy=0x7f07cc145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 >> v1:172.21.15.203:6790/0 conn(0x7f07cc0a23e0 legacy=0x7f07cc0a27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 monclient: found mon.noname-e 2024-09-11T01:58:30.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc068be0 con 0x7f07cc0a1750 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f07bc001830 con 0x7f07cc0a1750 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: dump: 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.450 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07d132b640 5 monclient: authenticate success, global_id 4256 2024-09-11T01:58:30.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07d132b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f03900b8640 1 -- 172.21.15.73:0/4279959641 shutdown_connections 2024-09-11T01:58:30.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f03900b8640 1 -- 172.21.15.73:0/4279959641 wait complete. 2024-09-11T01:58:30.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07bc0019d0 con 0x7f07cc0a1750 2024-09-11T01:58:30.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07d132b640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07d132b640 4 set_mon_vals no callback set 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 1 -- 172.21.15.73:0/2335550239 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f07bc001c00 con 0x7f07cc0a1750 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7f07c9ffb640 10 monclient: dump: 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.453 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7fe4b911a640 1 Processor -- start 2024-09-11T01:58:30.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7fe4b911a640 1 -- start start 2024-09-11T01:58:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.403+0000 7fe4b911a640 10 monclient: init 2024-09-11T01:58:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f03900b8640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f03900b8640 10 monclient: monmap: 2024-09-11T01:58:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fa341b2b640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fa341b2b640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fa341b2b640 10 monclient: monmap: 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.405078+0000 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.405078+0000 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.457 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.458 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.458 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.458 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.458 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 10 monclient: _add_conns ranks=[0,5,7,4,6,8,3,2,1] 2024-09-11T01:58:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 10 monclient(hunting): picked mon.noname-a con 0x7fe4ac027d50 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 10 monclient(hunting): picked mon.noname-h con 0x7fe4ac022ad0 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 10 monclient(hunting): picked mon.noname-i con 0x7fe4ac0c2c00 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac0b95e0 con 0x7fe4ac027d50 2024-09-11T01:58:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac0230f0 con 0x7fe4ac022ad0 2024-09-11T01:58:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac0205f0 con 0x7fe4ac0c2c00 2024-09-11T01:58:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b911a640 10 monclient(hunting): authenticate will time out at 752.008461s 2024-09-11T01:58:30.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f07d132b640 10 monclient: shutdown 2024-09-11T01:58:30.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f07d132b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f07d132b640 1 -- 172.21.15.73:0/2335550239 >> v1:172.21.15.73:6793/0 conn(0x7f07cc0a1750 legacy=0x7f07cc1427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe4ac027d50 0x7fe4ac0223c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39860/0 (socket says 172.21.15.73:39860) 2024-09-11T01:58:30.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b3fff640 1 -- 172.21.15.73:0/889130049 learned_addr learned my addr 172.21.15.73:0/889130049 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f07d132b640 1 -- 172.21.15.73:0/2335550239 shutdown_connections 2024-09-11T01:58:30.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f07d132b640 1 -- 172.21.15.73:0/2335550239 >> 172.21.15.73:0/2335550239 conn(0x7f07cc0a7a10 msgr2=0x7f07cc0a7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f07d132b640 1 -- 172.21.15.73:0/2335550239 shutdown_connections 2024-09-11T01:58:30.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f07d132b640 1 -- 172.21.15.73:0/2335550239 wait complete. 2024-09-11T01:58:30.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f03900b8640 1 Processor -- start 2024-09-11T01:58:30.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275947893 0 0) 0x7fe4ac0b95e0 con 0x7fe4ac027d50 2024-09-11T01:58:30.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 10 monclient(hunting): my global_id is 4329 2024-09-11T01:58:30.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4a4003520 con 0x7fe4ac027d50 2024-09-11T01:58:30.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f03900b8640 1 -- start start 2024-09-11T01:58:30.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7f03900b8640 10 monclient: init 2024-09-11T01:58:30.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022811030 0 0) 0x7fe4ac0230f0 con 0x7fe4ac022ad0 2024-09-11T01:58:30.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 10 monclient(hunting): my global_id is 4316 2024-09-11T01:58:30.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4ac0b95e0 con 0x7fe4ac022ad0 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.404+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694921345 0 0) 0x7fe4ac0205f0 con 0x7fe4ac0c2c00 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient(hunting): my global_id is 4255 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4ac0230f0 con 0x7fe4ac0c2c00 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4095838645 0 0) 0x7fe4a4003520 con 0x7fe4ac027d50 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 >> v1:172.21.15.203:6792/0 conn(0x7fe4ac0c2c00 legacy=0x7fe4ac0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 >> v1:172.21.15.203:6791/0 conn(0x7fe4ac022ad0 legacy=0x7fe4ac0c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 1 monclient: found mon.noname-a 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac0208d0 con 0x7fe4ac027d50 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe4a8001830 con 0x7fe4ac027d50 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b911a640 5 monclient: authenticate success, global_id 4329 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: dump: 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4a80019d0 con 0x7fe4ac027d50 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 1 -- 172.21.15.73:0/889130049 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe4a8004be0 con 0x7fe4ac027d50 2024-09-11T01:58:30.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 10 monclient: _add_conns ranks=[6,8,1,5,4,0,2,3,7] 2024-09-11T01:58:30.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b2ffd640 10 monclient: dump: 2024-09-11T01:58:30.467 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.467 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.467 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.467 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b911a640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fe4b911a640 4 set_mon_vals no callback set 2024-09-11T01:58:30.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fa341b2b640 1 Processor -- start 2024-09-11T01:58:30.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f07d132b640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 10 monclient(hunting): picked mon.noname-d con 0x7f0388138960 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 10 monclient(hunting): picked mon.noname-e con 0x7f0388139450 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f07d132b640 10 monclient: monmap: 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.471 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.471 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.471 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.471 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.471 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 10 monclient(hunting): picked mon.noname-f con 0x7f038813f620 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:30.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038813c7c0 con 0x7f038813f620 2024-09-11T01:58:30.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fa341b2b640 1 -- start start 2024-09-11T01:58:30.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7fa341b2b640 10 monclient: init 2024-09-11T01:58:30.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03881ce130 con 0x7f0388138960 2024-09-11T01:58:30.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f038d653640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f0388139450 0x7f03881cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38840/0 (socket says 172.21.15.73:38840) 2024-09-11T01:58:30.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f038d653640 1 -- 172.21.15.73:0/1067562348 learned_addr learned my addr 172.21.15.73:0/1067562348 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0388142a30 con 0x7f0388139450 2024-09-11T01:58:30.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f03900b8640 10 monclient(hunting): authenticate will time out at 752.009709s 2024-09-11T01:58:30.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359976214 0 0) 0x7f03881ce130 con 0x7f0388138960 2024-09-11T01:58:30.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 10 monclient(hunting): my global_id is 4272 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f036c003550 con 0x7f0388138960 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608246772 0 0) 0x7f038813c7c0 con 0x7f038813f620 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 10 monclient(hunting): my global_id is 4267 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03881ce130 con 0x7f038813f620 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.405+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887312247 0 0) 0x7f0388142a30 con 0x7f0388139450 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): my global_id is 4265 2024-09-11T01:58:30.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f038813c7c0 con 0x7f0388139450 2024-09-11T01:58:30.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 1 Processor -- start 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3615142702 0 0) 0x7f036c003550 con 0x7f0388138960 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0388142a30 con 0x7f0388138960 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0384001410 con 0x7f0388138960 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): dump: 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.476 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3678479192 0 0) 0x7f03881ce130 con 0x7f038813f620 2024-09-11T01:58:30.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f036c003550 con 0x7f038813f620 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0380001c20 con 0x7f038813f620 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): dump: 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.478 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.479 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 10 monclient: _add_conns ranks=[5,0,8,2,4,7,6,3,1] 2024-09-11T01:58:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 10 monclient(hunting): picked mon.noname-h con 0x7fa33c073860 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 10 monclient(hunting): picked mon.noname-a con 0x7fa33c0a1d20 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 10 monclient(hunting): picked mon.noname-e con 0x7fa33c13d0c0 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33c0a26c0 con 0x7fa33c0a1d20 2024-09-11T01:58:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33c0a29a0 con 0x7fa33c073860 2024-09-11T01:58:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fe4b911a640 10 monclient: shutdown 2024-09-11T01:58:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fe4b911a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fe4b911a640 1 -- 172.21.15.73:0/889130049 >> v1:172.21.15.73:6789/0 conn(0x7fe4ac027d50 legacy=0x7fe4ac0223c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33c071390 con 0x7fa33c13d0c0 2024-09-11T01:58:30.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa341b2b640 10 monclient(hunting): authenticate will time out at 752.010463s 2024-09-11T01:58:30.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 118973207 0 0) 0x7f038813c7c0 con 0x7f0388139450 2024-09-11T01:58:30.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa33b7fe640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7fa33c073860 0x7fa33c073c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.73:55616/0 (socket says 172.21.15.73:55616) 2024-09-11T01:58:30.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa33b7fe640 1 -- 172.21.15.73:0/3989705440 learned_addr learned my addr 172.21.15.73:0/3989705440 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fe4b911a640 1 -- 172.21.15.73:0/889130049 shutdown_connections 2024-09-11T01:58:30.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fe4b911a640 1 -- 172.21.15.73:0/889130049 >> 172.21.15.73:0/889130049 conn(0x7fe4ac0070e0 msgr2=0x7fe4ac0074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03881ce130 con 0x7f0388139450 2024-09-11T01:58:30.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 1 -- start start 2024-09-11T01:58:30.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 10 monclient: init 2024-09-11T01:58:30.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fe4b911a640 1 -- 172.21.15.73:0/889130049 shutdown_connections 2024-09-11T01:58:30.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0378001530 con 0x7f0388139450 2024-09-11T01:58:30.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:30.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient(hunting): dump: 2024-09-11T01:58:30.483 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.483 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.483 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.484 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458841969 0 0) 0x7fa33c0a29a0 con 0x7fa33c073860 2024-09-11T01:58:30.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa33affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa33affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa33affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa33affd640 10 monclient(hunting): my global_id is 4325 2024-09-11T01:58:30.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa328003520 con 0x7fa33c073860 2024-09-11T01:58:30.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1366831588 0 0) 0x7f036c003550 con 0x7f038813f620 2024-09-11T01:58:30.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 >> v1:172.21.15.73:6793/0 conn(0x7f0388139450 legacy=0x7f03881cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 10 monclient: _add_conns ranks=[1,7,4,3,8,6,5,2,0] 2024-09-11T01:58:30.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 10 monclient(hunting): picked mon.noname-f con 0x7f07cc0a1750 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:30.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 10 monclient(hunting): picked mon.noname-i con 0x7f07cc0a23e0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 10 monclient(hunting): picked mon.noname-c con 0x7f07cc0a2ed0 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:30.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc147420 con 0x7f07cc0a1750 2024-09-11T01:58:30.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc09dac0 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc0a4b50 con 0x7f07cc0a23e0 2024-09-11T01:58:30.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f07d132b640 10 monclient(hunting): authenticate will time out at 752.010989s 2024-09-11T01:58:30.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 474974662 0 0) 0x7fa33c0a26c0 con 0x7fa33c0a1d20 2024-09-11T01:58:30.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient(hunting): my global_id is 4338 2024-09-11T01:58:30.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa33c0a29a0 con 0x7fa33c0a1d20 2024-09-11T01:58:30.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 >> v1:172.21.15.73:6792/0 conn(0x7f0388138960 legacy=0x7f03881cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810326883 0 0) 0x7fa33c071390 con 0x7fa33c13d0c0 2024-09-11T01:58:30.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient(hunting): my global_id is 4274 2024-09-11T01:58:30.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa33c0a26c0 con 0x7fa33c13d0c0 2024-09-11T01:58:30.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 915131973 0 0) 0x7fa328003520 con 0x7fa33c073860 2024-09-11T01:58:30.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7fe4b911a640 1 -- 172.21.15.73:0/889130049 wait complete. 2024-09-11T01:58:30.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07cb7fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f07cc0a2ed0 0x7f07cc1da810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51900/0 (socket says 172.21.15.73:51900) 2024-09-11T01:58:30.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07cb7fe640 1 -- 172.21.15.73:0/1187654247 learned_addr learned my addr 172.21.15.73:0/1187654247 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 >> v1:172.21.15.73:6793/0 conn(0x7fa33c13d0c0 legacy=0x7fa33c13f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 >> v1:172.21.15.73:6789/0 conn(0x7fa33c0a1d20 legacy=0x7fa33c13b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 monclient: found mon.noname-h 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.203:6791/0 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c0a3380 con 0x7fa33c073860 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa32c001830 con 0x7fa33c073860 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: dump: 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.491 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa341b2b640 5 monclient: authenticate success, global_id 4325 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa341b2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 <== mon.5 v1:172.21.15.203:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa32c0019d0 con 0x7fa33c073860 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 1 -- 172.21.15.73:0/3989705440 <== mon.5 v1:172.21.15.203:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa32c004be0 con 0x7fa33c073860 2024-09-11T01:58:30.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775616445 0 0) 0x7f07cc09dac0 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:30.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa33affd640 10 monclient: dump: 2024-09-11T01:58:30.493 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.493 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.493 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.493 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.493 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.493 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa341b2b640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fa341b2b640 4 set_mon_vals no callback set 2024-09-11T01:58:30.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): my global_id is 4324 2024-09-11T01:58:30.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07b8003520 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fe4b911a640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7fe4b911a640 10 monclient: monmap: 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.496 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 monclient: found mon.f 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038813f030 con 0x7f038813f620 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f03900b8640 5 monclient: authenticate success, global_id 4267 2024-09-11T01:58:30.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f03900b8640 10 monclient: _renew_subs 2024-09-11T01:58:30.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f03900b8640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:30.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.203:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f038813c4e0 con 0x7f038813f620 2024-09-11T01:58:30.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3492825566 0 0) 0x7f07cc0a4b50 con 0x7f07cc0a23e0 2024-09-11T01:58:30.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f03900b8640 10 monclient: _renew_subs 2024-09-11T01:58:30.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f03900b8640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:30.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.203:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f03880a4910 con 0x7f038813f620 2024-09-11T01:58:30.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.1 v1:172.21.15.203:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0380003970 con 0x7f038813f620 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.1 v1:172.21.15.203:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0380003e60 con 0x7f038813f620 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037e7fc640 10 monclient: dump: 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.499 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.500 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.500 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.500 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.500 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.500 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.406+0000 7f037ffff640 4 set_mon_vals no callback set 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): my global_id is 4264 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07cc09dac0 con 0x7f07cc0a23e0 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275995033 0 0) 0x7f07cc147420 con 0x7f07cc0a1750 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 10 monclient(hunting): my global_id is 4276 2024-09-11T01:58:30.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.407+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07cc0a4b50 con 0x7f07cc0a1750 2024-09-11T01:58:30.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fe4b911a640 1 Processor -- start 2024-09-11T01:58:30.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 775633892 0 0) 0x7f07b8003520 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07cc147420 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1627615195 0 0) 0x7f07cc09dac0 con 0x7f07cc0a23e0 2024-09-11T01:58:30.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07b8003520 con 0x7f07cc0a23e0 2024-09-11T01:58:30.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f07c4001e30 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fa341b2b640 10 monclient: shutdown 2024-09-11T01:58:30.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:30.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fa341b2b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fa341b2b640 1 -- 172.21.15.73:0/3989705440 >> v1:172.21.15.203:6791/0 conn(0x7fa33c073860 legacy=0x7fa33c073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient(hunting): dump: 2024-09-11T01:58:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.504 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f07bc0010a0 con 0x7f07cc0a23e0 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fa341b2b640 1 -- 172.21.15.73:0/3989705440 shutdown_connections 2024-09-11T01:58:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient(hunting): dump: 2024-09-11T01:58:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.506 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fa341b2b640 1 -- 172.21.15.73:0/3989705440 >> 172.21.15.73:0/3989705440 conn(0x7fa33c0688e0 msgr2=0x7fa33c068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fe4b911a640 1 -- start start 2024-09-11T01:58:30.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fe4b911a640 10 monclient: init 2024-09-11T01:58:30.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1777264671 0 0) 0x7f07cc147420 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 >> v1:172.21.15.203:6792/0 conn(0x7f07cc0a23e0 legacy=0x7f07cc1d70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 >> v1:172.21.15.203:6789/0 conn(0x7f07cc0a1750 legacy=0x7f07cc146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 monclient: found mon.c 2024-09-11T01:58:30.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.1 v1:172.21.15.203:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f03800105a0 con 0x7f038813f620 2024-09-11T01:58:30.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc1424d0 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f03900b8640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:30.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.203:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f038813c2e0 con 0x7f038813f620 2024-09-11T01:58:30.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fa341b2b640 1 -- 172.21.15.73:0/3989705440 shutdown_connections 2024-09-11T01:58:30.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7fa341b2b640 1 -- 172.21.15.73:0/3989705440 wait complete. 2024-09-11T01:58:30.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07d132b640 5 monclient: authenticate success, global_id 4324 2024-09-11T01:58:30.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07d132b640 10 monclient: _renew_subs 2024-09-11T01:58:30.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07d132b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f07cc1427b0 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07d132b640 10 monclient: _renew_subs 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07d132b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f07cc141b70 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07c4003c40 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.408+0000 7f07b37fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f07c4004130 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f07b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f07c97fa640 4 set_mon_vals no callback set 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f07b37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f07b37fe640 10 monclient: dump: 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.513 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.514 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.1 v1:172.21.15.203:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f038004d240 con 0x7f038813f620 2024-09-11T01:58:30.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f038de54640 10 monclient: get_auth_request con 0x7f036c040760 auth_method 0 2024-09-11T01:58:30.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fe4b911a640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fe4b911a640 10 monclient: _add_conns ranks=[6,0,7,1,3,2,4,5,8] 2024-09-11T01:58:30.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fe4b911a640 10 monclient(hunting): picked mon.noname-d con 0x7fe4ac022ad0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.73:6808/2154209098 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f036c04afe0 con 0x7f036c047330 2024-09-11T01:58:30.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== mon.1 v1:172.21.15.203:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f038004d650 con 0x7f038813f620 2024-09-11T01:58:30.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f037e7fc640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-11T01:58:30.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fa341b2b640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fe4b37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe4ac027d50 0x7fe4ac0ba8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39870/0 (socket says 172.21.15.73:39870) 2024-09-11T01:58:30.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f038d653640 10 monclient: get_auth_request con 0x7f036c047330 auth_method 0 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fa341b2b640 10 monclient: monmap: 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.517 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.518 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.518 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.518 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.518 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.518 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.518 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fe4b37fe640 1 -- 172.21.15.73:0/842512298 learned_addr learned my addr 172.21.15.73:0/842512298 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fe4b911a640 10 monclient(hunting): picked mon.noname-a con 0x7fe4ac027d50 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fe4b911a640 10 monclient(hunting): picked mon.noname-i con 0x7fe4ac0c2c00 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f07d132b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.73:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f07ac000f80 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.409+0000 7fa341b2b640 1 Processor -- start 2024-09-11T01:58:30.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b911a640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac0bbf70 con 0x7fe4ac027d50 2024-09-11T01:58:30.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 1 -- start start 2024-09-11T01:58:30.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 10 monclient: init 2024-09-11T01:58:30.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f07c40042d0 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b911a640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac0bbaf0 con 0x7fe4ac022ad0 2024-09-11T01:58:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b911a640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac0bde30 con 0x7fe4ac0c2c00 2024-09-11T01:58:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604658064 0 0) 0x7fe4ac0bbf70 con 0x7fe4ac027d50 2024-09-11T01:58:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b911a640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b911a640 10 monclient(hunting): authenticate will time out at 752.014444s 2024-09-11T01:58:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): my global_id is 4347 2024-09-11T01:58:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe498003520 con 0x7fe4ac027d50 2024-09-11T01:58:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f07c404e590 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.203:6800/464336651 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07b804ada0 con 0x7f07b80470f0 2024-09-11T01:58:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f07c404ea00 con 0x7f07cc0a2ed0 2024-09-11T01:58:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7f07b37fe640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-11T01:58:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7f07caffd640 10 monclient: get_auth_request con 0x7f07b80404f0 auth_method 0 2024-09-11T01:58:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== osd.2 v1:172.21.15.73:6808/2154209098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f036c04afe0 con 0x7f036c047330 2024-09-11T01:58:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 10 monclient: _add_conns ranks=[4,7,0,2,6,1,8,5,3] 2024-09-11T01:58:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 10 monclient(hunting): picked mon.noname-c con 0x7fa33c0a1d20 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 10 monclient(hunting): picked mon.noname-i con 0x7fa33c13d0c0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 10 monclient(hunting): picked mon.noname-a con 0x7fa33c126c00 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33c126700 con 0x7fa33c126c00 2024-09-11T01:58:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33c1cea50 con 0x7fa33c0a1d20 2024-09-11T01:58:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33c125890 con 0x7fa33c13d0c0 2024-09-11T01:58:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa341b2b640 10 monclient(hunting): authenticate will time out at 752.014808s 2024-09-11T01:58:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241367830 0 0) 0x7fe4ac0bde30 con 0x7fe4ac0c2c00 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): my global_id is 4273 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4ac0bbf70 con 0x7fe4ac0c2c00 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1090315548 0 0) 0x7fe498003520 con 0x7fe4ac027d50 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4ac0bde30 con 0x7fe4ac027d50 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe4a0001b30 con 0x7fe4ac027d50 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.529 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494958041 0 0) 0x7fe4ac0bbaf0 con 0x7fe4ac022ad0 2024-09-11T01:58:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7f07ca7fc640 10 monclient: get_auth_request con 0x7f07b80470f0 auth_method 0 2024-09-11T01:58:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 10 monclient(hunting): my global_id is 4281 2024-09-11T01:58:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe498003520 con 0x7fe4ac022ad0 2024-09-11T01:58:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa33b7fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fa33c0a1d20 0x7fa33c1cdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51914/0 (socket says 172.21.15.73:51914) 2024-09-11T01:58:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.410+0000 7fa33b7fe640 1 -- 172.21.15.73:0/2979017116 learned_addr learned my addr 172.21.15.73:0/2979017116 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3892821601 0 0) 0x7fe4ac0bde30 con 0x7fe4ac027d50 2024-09-11T01:58:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 >> v1:172.21.15.203:6792/0 conn(0x7fe4ac0c2c00 legacy=0x7fe4ac15d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 >> v1:172.21.15.73:6792/0 conn(0x7fe4ac022ad0 legacy=0x7fe4ac0ba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908647074 0 0) 0x7fa33c1cea50 con 0x7fa33c0a1d20 2024-09-11T01:58:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): my global_id is 4333 2024-09-11T01:58:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa31c003520 con 0x7fa33c0a1d20 2024-09-11T01:58:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754416658 0 0) 0x7fa33c125890 con 0x7fa33c13d0c0 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): my global_id is 4282 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa33c1cea50 con 0x7fa33c13d0c0 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 1 monclient: found mon.a 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac0c1fc0 con 0x7fe4ac027d50 2024-09-11T01:58:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291325708 0 0) 0x7fa33c126700 con 0x7fa33c126c00 2024-09-11T01:58:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): my global_id is 4356 2024-09-11T01:58:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa33c125890 con 0x7fa33c126c00 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b911a640 5 monclient: authenticate success, global_id 4347 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b911a640 10 monclient: _renew_subs 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b911a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b911a640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ac0bafd0 con 0x7fe4ac027d50 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4a00038c0 con 0x7fe4ac027d50 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b911a640 10 monclient: _renew_subs 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b911a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b911a640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4ac15eb30 con 0x7fe4ac027d50 2024-09-11T01:58:30.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3630170563 0 0) 0x7fa33c1cea50 con 0x7fa33c13d0c0 2024-09-11T01:58:30.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa33c126700 con 0x7fa33c13d0c0 2024-09-11T01:58:30.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa324001ad0 con 0x7fa33c13d0c0 2024-09-11T01:58:30.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe4a0003e70 con 0x7fe4ac027d50 2024-09-11T01:58:30.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b27fc640 4 set_mon_vals no callback set 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fe4b0ff9640 10 monclient: dump: 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.538 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1554692240 0 0) 0x7fa31c003520 con 0x7fa33c0a1d20 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa33c1cea50 con 0x7fa33c0a1d20 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa32c001770 con 0x7fa33c0a1d20 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.541 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1319176241 0 0) 0x7fa33c1cea50 con 0x7fa33c0a1d20 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 >> v1:172.21.15.203:6792/0 conn(0x7fa33c13d0c0 legacy=0x7fa33c1ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 >> v1:172.21.15.73:6789/0 conn(0x7fa33c126c00 legacy=0x7fa33c1d5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 monclient: found mon.c 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c09f4c0 con 0x7fa33c0a1d20 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa338ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa341b2b640 5 monclient: authenticate success, global_id 4333 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa341b2b640 10 monclient: _renew_subs 2024-09-11T01:58:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa341b2b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.411+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa33c124a10 con 0x7fa33c0a1d20 2024-09-11T01:58:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa341b2b640 10 monclient: _renew_subs 2024-09-11T01:58:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa341b2b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa33c125170 con 0x7fa33c0a1d20 2024-09-11T01:58:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa32c004ad0 con 0x7fa33c0a1d20 2024-09-11T01:58:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== osd.5 v1:172.21.15.203:6800/464336651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f07b804ada0 con 0x7f07b80470f0 2024-09-11T01:58:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fe49e7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fe49e7fc640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe48c000f80 con 0x7fe4ac027d50 2024-09-11T01:58:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa338ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa32c005220 con 0x7fa33c0a1d20 2024-09-11T01:58:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa338ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa338ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa338ff9640 10 monclient: dump: 2024-09-11T01:58:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.544 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.545 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fa33a7fc640 4 set_mon_vals no callback set 2024-09-11T01:58:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.412+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fe4a0004010 con 0x7fe4ac027d50 2024-09-11T01:58:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7fe4a004e370 con 0x7fe4ac027d50 2024-09-11T01:58:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6804/3691603832 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe49804a710 con 0x7fe498046a60 2024-09-11T01:58:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fa32c011960 con 0x7fa33c0a1d20 2024-09-11T01:58:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7fe4a004e770 con 0x7fe4ac027d50 2024-09-11T01:58:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fe4b0ff9640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-11T01:58:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fe4b3fff640 10 monclient: get_auth_request con 0x7fe49803fe80 auth_method 0 2024-09-11T01:58:30.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fa341b2b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.73:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa33c074c90 con 0x7fa33c0a1d20 2024-09-11T01:58:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fe4b8919640 10 monclient: get_auth_request con 0x7fe498046a60 auth_method 0 2024-09-11T01:58:30.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7fa32c04e190 con 0x7fa33c0a1d20 2024-09-11T01:58:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.203:6804/1562443458 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa32c0019d0 con 0x7fa31c047140 2024-09-11T01:58:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7fa32c04e5a0 con 0x7fa33c0a1d20 2024-09-11T01:58:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fa338ff9640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-11T01:58:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.413+0000 7fa333fff640 10 monclient: get_auth_request con 0x7fa31c040540 auth_method 0 2024-09-11T01:58:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.414+0000 7fa33bfff640 10 monclient: get_auth_request con 0x7fa31c047140 auth_method 0 2024-09-11T01:58:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.414+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== osd.0 v1:172.21.15.73:6804/3691603832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fe49804a710 con 0x7fe498046a60 2024-09-11T01:58:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.415+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== osd.4 v1:172.21.15.203:6804/1562443458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fa32c0019d0 con 0x7fa31c047140 2024-09-11T01:58:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.425+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 --> v1:172.21.15.73:6808/2154209098 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0388143380 con 0x7f036c047330 2024-09-11T01:58:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f037e7fc640 1 -- 172.21.15.73:0/1067562348 <== osd.2 v1:172.21.15.73:6808/2154209098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 700469118) 0x7f0388143380 con 0x7f036c047330 2024-09-11T01:58:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 >> v1:172.21.15.73:6808/2154209098 conn(0x7f036c047330 legacy=0x7f036c049770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 >> v1:172.21.15.203:6812/2311533528 conn(0x7f036c040760 legacy=0x7f036c042c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f03900b8640 10 monclient: shutdown 2024-09-11T01:58:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f03900b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 >> v1:172.21.15.203:6789/0 conn(0x7f038813f620 legacy=0x7f03881d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f038e655640 1 -- 172.21.15.73:0/1067562348 reap_dead start 2024-09-11T01:58:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 shutdown_connections 2024-09-11T01:58:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 >> 172.21.15.73:0/1067562348 conn(0x7f03880a8050 msgr2=0x7f03880a8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 shutdown_connections 2024-09-11T01:58:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.426+0000 7f03900b8640 1 -- 172.21.15.73:0/1067562348 wait complete. 2024-09-11T01:58:30.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe49e7fc640 1 -- 172.21.15.73:0/842512298 --> v1:172.21.15.73:6804/3691603832 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe48c002c70 con 0x7fe498046a60 2024-09-11T01:58:30.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe4b0ff9640 1 -- 172.21.15.73:0/842512298 <== osd.0 v1:172.21.15.73:6804/3691603832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 700469118) 0x7fe48c002c70 con 0x7fe498046a60 2024-09-11T01:58:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe49e7fc640 1 -- 172.21.15.73:0/842512298 >> v1:172.21.15.73:6804/3691603832 conn(0x7fe498046a60 legacy=0x7fe498048ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe49e7fc640 1 -- 172.21.15.73:0/842512298 >> v1:172.21.15.203:6812/2311533528 conn(0x7fe49803fe80 legacy=0x7fe498042340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe49e7fc640 10 monclient: shutdown 2024-09-11T01:58:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe49e7fc640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe49e7fc640 1 -- 172.21.15.73:0/842512298 >> v1:172.21.15.73:6789/0 conn(0x7fe4ac027d50 legacy=0x7fe4ac0ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe4b8919640 1 -- 172.21.15.73:0/842512298 reap_dead start 2024-09-11T01:58:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe49e7fc640 1 -- 172.21.15.73:0/842512298 shutdown_connections 2024-09-11T01:58:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.428+0000 7fe49e7fc640 1 -- 172.21.15.73:0/842512298 >> 172.21.15.73:0/842512298 conn(0x7fe4ac0070e0 msgr2=0x7fe4ac025bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.429+0000 7fe49e7fc640 1 -- 172.21.15.73:0/842512298 shutdown_connections 2024-09-11T01:58:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.429+0000 7fe49e7fc640 1 -- 172.21.15.73:0/842512298 wait complete. 2024-09-11T01:58:30.555 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-09-11T01:58:30.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T01:58:30.557 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-09-11T01:58:30.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T01:58:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.440+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 --> v1:172.21.15.203:6800/464336651 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f07ac002c70 con 0x7f07b80470f0 2024-09-11T01:58:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.441+0000 7f07b37fe640 1 -- 172.21.15.73:0/1187654247 <== osd.5 v1:172.21.15.203:6800/464336651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 258058390) 0x7f07ac002c70 con 0x7f07b80470f0 2024-09-11T01:58:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 >> v1:172.21.15.203:6800/464336651 conn(0x7f07b80470f0 legacy=0x7f07b8049530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 >> v1:172.21.15.203:6812/2311533528 conn(0x7f07b80404f0 legacy=0x7f07b80429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07d132b640 10 monclient: shutdown 2024-09-11T01:58:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07d132b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 >> v1:172.21.15.73:6791/0 conn(0x7f07cc0a2ed0 legacy=0x7f07cc1da810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07cb7fe640 1 -- 172.21.15.73:0/1187654247 reap_dead start 2024-09-11T01:58:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 shutdown_connections 2024-09-11T01:58:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 >> 172.21.15.73:0/1187654247 conn(0x7f07cc0a7a10 msgr2=0x7f07cc140830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 shutdown_connections 2024-09-11T01:58:30.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.442+0000 7f07d132b640 1 -- 172.21.15.73:0/1187654247 wait complete. 2024-09-11T01:58:30.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.444+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 --> v1:172.21.15.203:6804/1562443458 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa33c0637e0 con 0x7fa31c047140 2024-09-11T01:58:30.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.444+0000 7fa338ff9640 1 -- 172.21.15.73:0/2979017116 <== osd.4 v1:172.21.15.203:6804/1562443458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 4245302165) 0x7fa33c0637e0 con 0x7fa31c047140 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 >> v1:172.21.15.203:6804/1562443458 conn(0x7fa31c047140 legacy=0x7fa31c049580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 >> v1:172.21.15.203:6812/2311533528 conn(0x7fa31c040540 legacy=0x7fa31c042a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa341b2b640 10 monclient: shutdown 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa341b2b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 >> v1:172.21.15.73:6791/0 conn(0x7fa33c0a1d20 legacy=0x7fa33c1cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa33bfff640 1 -- 172.21.15.73:0/2979017116 reap_dead start 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 shutdown_connections 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 >> 172.21.15.73:0/2979017116 conn(0x7fa33c0688e0 msgr2=0x7fa33c0a77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 shutdown_connections 2024-09-11T01:58:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.445+0000 7fa341b2b640 1 -- 172.21.15.73:0/2979017116 wait complete. 2024-09-11T01:58:30.562 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2024-09-11T01:58:30.562 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T01:58:30.563 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-09-11T01:58:30.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T01:58:30.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.661+0000 7fa111ab6640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.661+0000 7fa111ab6640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.661+0000 7fa111ab6640 10 monclient: monmap: 2024-09-11T01:58:30.663 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.663 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.663 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.662254+0000 2024-09-11T01:58:30.663 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.662254+0000 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.664 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.662+0000 7fa111ab6640 1 Processor -- start 2024-09-11T01:58:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.662+0000 7fa111ab6640 1 -- start start 2024-09-11T01:58:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.662+0000 7fa111ab6640 10 monclient: init 2024-09-11T01:58:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.662+0000 7fa111ab6640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.662+0000 7fa111ab6640 10 monclient: _add_conns ranks=[3,1,8,4,2,7,6,5,0] 2024-09-11T01:58:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.662+0000 7fa111ab6640 10 monclient(hunting): picked mon.noname-g con 0x7fa10c138960 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.662+0000 7fa111ab6640 10 monclient(hunting): picked mon.noname-f con 0x7fa10c139450 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.662+0000 7fa111ab6640 10 monclient(hunting): picked mon.noname-e con 0x7fa10c13f620 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa111ab6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c09d030 con 0x7fa10c139450 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa111ab6640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c09d310 con 0x7fa10c138960 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa111ab6640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c06f770 con 0x7fa10c13f620 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa111ab6640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa111ab6640 10 monclient(hunting): authenticate will time out at 752.267116s 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10bfff640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fa10c13f620 0x7fa10c141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38858/0 (socket says 172.21.15.73:38858) 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10bfff640 1 -- 172.21.15.73:0/1510409059 learned_addr learned my addr 172.21.15.73:0/1510409059 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522781872 0 0) 0x7fa10c09d310 con 0x7fa10c138960 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): my global_id is 4314 2024-09-11T01:58:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0f4003520 con 0x7fa10c138960 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904803007 0 0) 0x7fa10c09d030 con 0x7fa10c139450 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): my global_id is 4285 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa10c09d310 con 0x7fa10c139450 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732703458 0 0) 0x7fa10c06f770 con 0x7fa10c13f620 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient(hunting): my global_id is 4283 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa10c09d030 con 0x7fa10c13f620 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3292857680 0 0) 0x7fa10c09d310 con 0x7fa10c139450 2024-09-11T01:58:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 >> v1:172.21.15.73:6793/0 conn(0x7fa10c13f620 legacy=0x7fa10c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 >> v1:172.21.15.203:6790/0 conn(0x7fa10c138960 legacy=0x7fa10c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 monclient: found mon.noname-f 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.203:6789/0 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c0a7360 con 0x7fa10c139450 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa100001810 con 0x7fa10c139450 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T01:58:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.663+0000 7fa10a7fc640 10 monclient: dump: 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa111ab6640 5 monclient: authenticate success, global_id 4285 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa111ab6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 <== mon.1 v1:172.21.15.203:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa100001a30 con 0x7fa10c139450 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa10a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa10a7fc640 1 -- 172.21.15.73:0/1510409059 <== mon.1 v1:172.21.15.203:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa100001810 con 0x7fa10c139450 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa10a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa10a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa10a7fc640 10 monclient: dump: 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa111ab6640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa111ab6640 4 set_mon_vals no callback set 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa111ab6640 10 monclient: shutdown 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa111ab6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.664+0000 7fa111ab6640 1 -- 172.21.15.73:0/1510409059 >> v1:172.21.15.203:6789/0 conn(0x7fa10c139450 legacy=0x7fa10c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.665+0000 7fa111ab6640 1 -- 172.21.15.73:0/1510409059 shutdown_connections 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.665+0000 7fa111ab6640 1 -- 172.21.15.73:0/1510409059 >> 172.21.15.73:0/1510409059 conn(0x7fa10c0a8050 msgr2=0x7fa10c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.665+0000 7fa111ab6640 1 -- 172.21.15.73:0/1510409059 shutdown_connections 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.665+0000 7fa111ab6640 1 -- 172.21.15.73:0/1510409059 wait complete. 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.665+0000 7fa111ab6640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.666+0000 7fa111ab6640 10 monclient: monmap: 2024-09-11T01:58:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.683 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.666+0000 7fa111ab6640 1 Processor -- start 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.666+0000 7fa111ab6640 1 -- start start 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.666+0000 7fa111ab6640 10 monclient: init 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.667+0000 7fa111ab6640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.667+0000 7fa111ab6640 10 monclient: _add_conns ranks=[5,3,0,8,1,2,7,4,6] 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.667+0000 7fa111ab6640 10 monclient(hunting): picked mon.noname-h con 0x7fa10c138960 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.667+0000 7fa111ab6640 10 monclient(hunting): picked mon.noname-g con 0x7fa10c139450 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.667+0000 7fa10bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa10c13f620 0x7fa10c1d5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39888/0 (socket says 172.21.15.73:39888) 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.667+0000 7fa10affd640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7fa10c139450 0x7fa10c1d2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.73:41262/0 (socket says 172.21.15.73:41262) 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.667+0000 7fa10b7fe640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7fa10c138960 0x7fa10c13e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.73:55626/0 (socket says 172.21.15.73:55626) 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.667+0000 7fa10bfff640 1 -- 172.21.15.73:0/2492758880 learned_addr learned my addr 172.21.15.73:0/2492758880 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa111ab6640 10 monclient(hunting): picked mon.noname-a con 0x7fa10c13f620 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa111ab6640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c0a51d0 con 0x7fa10c13f620 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052445801 0 0) 0x7fa10c0a51d0 con 0x7fa10c13f620 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa111ab6640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c13cbe0 con 0x7fa10c139450 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa111ab6640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10c13b3e0 con 0x7fa10c138960 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa111ab6640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa111ab6640 10 monclient(hunting): authenticate will time out at 752.272648s 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa0f3fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa0f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa0f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa0f3fff640 10 monclient(hunting): my global_id is 4365 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.668+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0f8003520 con 0x7fa10c13f620 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026224570 0 0) 0x7fa10c13cbe0 con 0x7fa10c139450 2024-09-11T01:58:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): my global_id is 4323 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa10c0a51d0 con 0x7fa10c139450 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2343994493 0 0) 0x7fa10c13b3e0 con 0x7fa10c138960 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): my global_id is 4334 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa10c13cbe0 con 0x7fa10c138960 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3415194527 0 0) 0x7fa0f8003520 con 0x7fa10c13f620 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa10c13b3e0 con 0x7fa10c13f620 2024-09-11T01:58:30.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa104001cf0 con 0x7fa10c13f620 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): dump: 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.687 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2908146929 0 0) 0x7fa10c13b3e0 con 0x7fa10c13f620 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 >> v1:172.21.15.203:6791/0 conn(0x7fa10c138960 legacy=0x7fa10c13e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 >> v1:172.21.15.203:6790/0 conn(0x7fa10c139450 legacy=0x7fa10c1d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 monclient: found mon.a 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c0a49e0 con 0x7fa10c13f620 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa111ab6640 5 monclient: authenticate success, global_id 4365 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa104004b60 con 0x7fa10c13f620 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa111ab6640 10 monclient: _renew_subs 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa111ab6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.669+0000 7fa111ab6640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa10c1cd8b0 con 0x7fa10c13f620 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.670+0000 7fa0f3fff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.670+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa104005110 con 0x7fa10c13f620 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.670+0000 7fa0f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.670+0000 7fa0f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.670+0000 7fa0f3fff640 10 monclient: dump: 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.690 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.670+0000 7fa109ffb640 4 set_mon_vals no callback set 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.670+0000 7fa111ab6640 10 monclient: _renew_subs 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.670+0000 7fa111ab6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.670+0000 7fa111ab6640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa10c13ea00 con 0x7fa10c13f620 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.671+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fa1040052b0 con 0x7fa10c13f620 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.671+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7fa10404e860 con 0x7fa10c13f620 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.672+0000 7fa10b7fe640 10 monclient: get_auth_request con 0x7fa0f803ffb0 auth_method 0 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.672+0000 7fa0f1ffb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.672+0000 7fa0f1ffb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.672+0000 7fa0f1ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.672+0000 7fa0f1ffb640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10c06a090 con 0x7fa10c13f620 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.677+0000 7fbebb033640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.677+0000 7fbebb033640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.677+0000 7fbebb033640 10 monclient: monmap: 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.678224+0000 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.678224+0000 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.695 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.678+0000 7fbebb033640 1 Processor -- start 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.678+0000 7fbebb033640 1 -- start start 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.678+0000 7fbebb033640 10 monclient: init 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 10 monclient: _add_conns ranks=[0,6,2,7,1,3,8,4,5] 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 10 monclient(hunting): picked mon.noname-a con 0x7fbeb4138960 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 10 monclient(hunting): picked mon.noname-d con 0x7fbeb4139450 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 10 monclient(hunting): picked mon.noname-b con 0x7fbeb413f620 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb409d030 con 0x7fbeb4138960 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb409d310 con 0x7fbeb413f620 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb406f770 con 0x7fbeb4139450 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbebb033640 10 monclient(hunting): authenticate will time out at 752.283186s 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb95d0640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fbeb413f620 0x7fbeb4141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41062/0 (socket says 172.21.15.73:41062) 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb95d0640 1 -- 172.21.15.73:0/1790784154 learned_addr learned my addr 172.21.15.73:0/1790784154 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1012557592 0 0) 0x7fbeb406f770 con 0x7fbeb4139450 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 10 monclient(hunting): my global_id is 4290 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbea4003520 con 0x7fbeb4139450 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 877271673 0 0) 0x7fbeb409d310 con 0x7fbeb413f620 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 10 monclient(hunting): my global_id is 4286 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.679+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeb406f770 con 0x7fbeb413f620 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2353379849 0 0) 0x7fbea4003520 con 0x7fbeb4139450 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 >> v1:172.21.15.73:6790/0 conn(0x7fbeb413f620 legacy=0x7fbeb4141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 >> v1:172.21.15.73:6789/0 conn(0x7fbeb4138960 legacy=0x7fbeb4138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 1 monclient: found mon.noname-d 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb40a7360 con 0x7fbeb4139450 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbea0001760 con 0x7fbeb4139450 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: dump: 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbebb033640 5 monclient: authenticate success, global_id 4290 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbebb033640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbea0001900 con 0x7fbeb4139450 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 1 -- 172.21.15.73:0/1790784154 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbea0001bb0 con 0x7fbeb4139450 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbeb37fe640 10 monclient: dump: 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbebb033640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.680+0000 7fbebb033640 4 set_mon_vals no callback set 2024-09-11T01:58:30.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.681+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fa104017900 con 0x7fa10c13f620 2024-09-11T01:58:30.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.681+0000 7fa0f3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.681+0000 7fa0f3fff640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:30.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.681+0000 7fbebb033640 10 monclient: shutdown 2024-09-11T01:58:30.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.681+0000 7fbebb033640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.681+0000 7fbebb033640 1 -- 172.21.15.73:0/1790784154 >> v1:172.21.15.73:6792/0 conn(0x7fbeb4139450 legacy=0x7fbeb413df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.684+0000 7fbebb033640 1 -- 172.21.15.73:0/1790784154 shutdown_connections 2024-09-11T01:58:30.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.684+0000 7fbebb033640 1 -- 172.21.15.73:0/1790784154 >> 172.21.15.73:0/1790784154 conn(0x7fbeb40a8050 msgr2=0x7fbeb40a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.684+0000 7fbebb033640 1 -- 172.21.15.73:0/1790784154 shutdown_connections 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.684+0000 7fbebb033640 1 -- 172.21.15.73:0/1790784154 wait complete. 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.684+0000 7fbebb033640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.684+0000 7fbebb033640 10 monclient: monmap: 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.710 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 1 Processor -- start 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 1 -- start start 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 10 monclient: init 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 10 monclient: _add_conns ranks=[1,4,7,2,8,0,6,3,5] 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 10 monclient(hunting): picked mon.noname-f con 0x7fbeb4138960 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:30.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 10 monclient(hunting): picked mon.noname-c con 0x7fbeb4139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 10 monclient(hunting): picked mon.noname-i con 0x7fbeb413f620 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb413c9f0 con 0x7fbeb4138960 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb413ccd0 con 0x7fbeb4139450 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb413eef0 con 0x7fbeb413f620 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.685+0000 7fbebb033640 10 monclient(hunting): authenticate will time out at 752.289951s 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb3fff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fbeb4139450 0x7fbeb41d2940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51920/0 (socket says 172.21.15.73:51920) 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb3fff640 1 -- 172.21.15.73:0/758644685 learned_addr learned my addr 172.21.15.73:0/758644685 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604673757 0 0) 0x7fbeb413ccd0 con 0x7fbeb4139450 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): my global_id is 4342 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe98003520 con 0x7fbeb4139450 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3936513319 0 0) 0x7fbeb413c9f0 con 0x7fbeb4138960 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): my global_id is 4294 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeb413ccd0 con 0x7fbeb4138960 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433580766 0 0) 0x7fbeb413eef0 con 0x7fbeb413f620 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 10 monclient(hunting): my global_id is 4291 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.686+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeb413c9f0 con 0x7fbeb413f620 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3412091385 0 0) 0x7fbe98003520 con 0x7fbeb4139450 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbeb413eef0 con 0x7fbeb4139450 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbea0003930 con 0x7fbeb4139450 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 10 monclient(hunting): dump: 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.714 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2413284158 0 0) 0x7fbeb413ccd0 con 0x7fbeb4138960 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe98003520 con 0x7fbeb4138960 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 148559345 0 0) 0x7fbeb413eef0 con 0x7fbeb4139450 2024-09-11T01:58:30.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 >> v1:172.21.15.203:6792/0 conn(0x7fbeb413f620 legacy=0x7fbeb41d6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 >> v1:172.21.15.203:6789/0 conn(0x7fbeb4138960 legacy=0x7fbeb413a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 monclient: found mon.c 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb413f360 con 0x7fbeb4139450 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbeb17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbebb033640 5 monclient: authenticate success, global_id 4342 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbebb033640 10 monclient: _renew_subs 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbebb033640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.687+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb40a1f70 con 0x7fbeb4139450 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbebb033640 10 monclient: _renew_subs 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbebb033640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fbeb413c430 con 0x7fbeb4139450 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbea0001b70 con 0x7fbeb4139450 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbeb17fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbea00040c0 con 0x7fbeb4139450 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbeb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbeb17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbeb17fa640 10 monclient: dump: 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.717 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.688+0000 7fbeb2ffd640 4 set_mon_vals no callback set 2024-09-11T01:58:30.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.689+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fbea0004260 con 0x7fbeb4139450 2024-09-11T01:58:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.689+0000 7fbebb033640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.689+0000 7fbebb033640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.689+0000 7fbebb033640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.689+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe94005080 con 0x7fbeb4139450 2024-09-11T01:58:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.690+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7fbea004e260 con 0x7fbeb4139450 2024-09-11T01:58:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.690+0000 7fbeb8dcf640 10 monclient: get_auth_request con 0x7fbe9803ffa0 auth_method 0 2024-09-11T01:58:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.694+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fbea00175d0 con 0x7fbeb4139450 2024-09-11T01:58:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.694+0000 7fbeb17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.694+0000 7fbeb17fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:30.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.715+0000 7f55f4517640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.715+0000 7f55f4517640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.715+0000 7f55f4517640 10 monclient: monmap: 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.716393+0000 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.716393+0000 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.733 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.716+0000 7f55f4517640 1 Processor -- start 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.716+0000 7f55f4517640 1 -- start start 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.716+0000 7f55f4517640 10 monclient: init 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.716+0000 7f55f4517640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.716+0000 7f55f4517640 10 monclient: _add_conns ranks=[2,4,0,6,5,7,8,3,1] 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f4517640 10 monclient(hunting): picked mon.noname-b con 0x7f55ec138960 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f4517640 10 monclient(hunting): picked mon.noname-c con 0x7f55ec139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f22b3640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f55ec138960 0x7f55ec138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41070/0 (socket says 172.21.15.73:41070) 2024-09-11T01:58:30.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f1ab2640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f55ec139450 0x7f55ec13df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51926/0 (socket says 172.21.15.73:51926) 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f4517640 10 monclient(hunting): picked mon.noname-a con 0x7f55ec13f620 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f22b3640 1 -- 172.21.15.73:0/1612446356 learned_addr learned my addr 172.21.15.73:0/1612446356 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f4517640 1 -- 172.21.15.73:0/1612446356 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ec09d030 con 0x7f55ec13f620 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f4517640 1 -- 172.21.15.73:0/1612446356 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ec09d310 con 0x7f55ec138960 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f4517640 1 -- 172.21.15.73:0/1612446356 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ec06f770 con 0x7f55ec139450 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f4517640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f4517640 10 monclient(hunting): authenticate will time out at 752.321446s 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285269134 0 0) 0x7f55ec09d030 con 0x7f55ec13f620 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): my global_id is 4374 2024-09-11T01:58:30.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d8003520 con 0x7f55ec13f620 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024574756 0 0) 0x7f55ec09d310 con 0x7f55ec138960 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): my global_id is 4295 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55ec09d030 con 0x7f55ec138960 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3846487816 0 0) 0x7f55ec06f770 con 0x7f55ec139450 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 10 monclient(hunting): my global_id is 4351 2024-09-11T01:58:30.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.717+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55ec09d310 con 0x7f55ec139450 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4078186315 0 0) 0x7f55d8003520 con 0x7f55ec13f620 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 >> v1:172.21.15.73:6791/0 conn(0x7f55ec139450 legacy=0x7f55ec13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 >> v1:172.21.15.73:6790/0 conn(0x7f55ec138960 legacy=0x7f55ec138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 1 monclient: found mon.noname-a 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ec0a7360 con 0x7f55ec13f620 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f55e4001bb0 con 0x7f55ec13f620 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f12b1640 10 monclient: dump: 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.738 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f4517640 5 monclient: authenticate success, global_id 4374 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.718+0000 7f55f4517640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55e4001d50 con 0x7f55ec13f620 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f12b1640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f12b1640 1 -- 172.21.15.73:0/1612446356 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f55e4003cb0 con 0x7f55ec13f620 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f4517640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f12b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f12b1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f12b1640 10 monclient: dump: 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.740 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f4517640 4 set_mon_vals no callback set 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f4517640 10 monclient: shutdown 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f4517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f4517640 1 -- 172.21.15.73:0/1612446356 >> v1:172.21.15.73:6789/0 conn(0x7f55ec13f620 legacy=0x7f55ec141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.719+0000 7f55f4517640 1 -- 172.21.15.73:0/1612446356 shutdown_connections 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.720+0000 7f55f4517640 1 -- 172.21.15.73:0/1612446356 >> 172.21.15.73:0/1612446356 conn(0x7f55ec0a8050 msgr2=0x7f55ec0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.720+0000 7f55f4517640 1 -- 172.21.15.73:0/1612446356 shutdown_connections 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.720+0000 7f55f4517640 1 -- 172.21.15.73:0/1612446356 wait complete. 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.720+0000 7f55f4517640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.720+0000 7f55f4517640 10 monclient: monmap: 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.742 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.721+0000 7f55f4517640 1 Processor -- start 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.721+0000 7f55f4517640 1 -- start start 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.721+0000 7f55f4517640 10 monclient: init 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.721+0000 7f55f4517640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.721+0000 7f55f4517640 10 monclient: _add_conns ranks=[5,3,6,7,2,0,1,4,8] 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.721+0000 7f55f4517640 10 monclient(hunting): picked mon.noname-h con 0x7f55ec138960 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:30.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.721+0000 7f55f4517640 10 monclient(hunting): picked mon.noname-g con 0x7f55ec139450 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.721+0000 7f55f4517640 10 monclient(hunting): picked mon.noname-d con 0x7f55ec13f620 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55f4517640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ec073550 con 0x7f55ec139450 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55f4517640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ec142ac0 con 0x7f55ec138960 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55f4517640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ec072890 con 0x7f55ec13f620 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55f4517640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55f4517640 10 monclient(hunting): authenticate will time out at 752.326039s 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55f2ab4640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f55ec13f620 0x7f55ec138200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:38164/0 (socket says 172.21.15.73:38164) 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55f2ab4640 1 -- 172.21.15.73:0/1796105091 learned_addr learned my addr 172.21.15.73:0/1796105091 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994472099 0 0) 0x7f55ec072890 con 0x7f55ec13f620 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): my global_id is 4299 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d0003520 con 0x7f55ec13f620 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110529293 0 0) 0x7f55ec09d310 con 0x7f55ec139450 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): my global_id is 4332 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55ec072890 con 0x7f55ec139450 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423862874 0 0) 0x7f55ec09d030 con 0x7f55ec138960 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): my global_id is 4343 2024-09-11T01:58:30.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55ec09d310 con 0x7f55ec138960 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4202620264 0 0) 0x7f55d0003520 con 0x7f55ec13f620 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55ec09d030 con 0x7f55ec13f620 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f55e4003970 con 0x7f55ec13f620 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.746 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 495947586 0 0) 0x7f55ec072890 con 0x7f55ec139450 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55d0003520 con 0x7f55ec139450 2024-09-11T01:58:30.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f55dc001a50 con 0x7f55ec139450 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.748 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3630193760 0 0) 0x7f55ec09d310 con 0x7f55ec138960 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55ec072890 con 0x7f55ec138960 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f55e8001a90 con 0x7f55ec138960 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:30.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.722+0000 7f55e2ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.750 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4280403602 0 0) 0x7f55d0003520 con 0x7f55ec139450 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 >> v1:172.21.15.73:6792/0 conn(0x7f55ec13f620 legacy=0x7f55ec138200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 >> v1:172.21.15.203:6791/0 conn(0x7f55ec138960 legacy=0x7f55ec071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 1 monclient: found mon.g 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.203:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ec072b70 con 0x7f55ec139450 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55f4517640 5 monclient: authenticate success, global_id 4332 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55f4517640 10 monclient: _renew_subs 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55f4517640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.203:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f55ec0a1c10 con 0x7f55ec139450 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55dc0047e0 con 0x7f55ec139450 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f55dc004cd0 con 0x7f55ec139450 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55f0ab0640 4 set_mon_vals no callback set 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55e2ffd640 10 monclient: dump: 2024-09-11T01:58:30.752 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.753 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55f4517640 10 monclient: _renew_subs 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.723+0000 7f55f4517640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.724+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.203:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f55ec071370 con 0x7f55ec139450 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.724+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f55dc011410 con 0x7f55ec139450 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.725+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f55dc04e470 con 0x7f55ec139450 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.725+0000 7f55f4517640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.725+0000 7f55f22b3640 10 monclient: get_auth_request con 0x7f55d00406c0 auth_method 0 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.725+0000 7f55f4517640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.725+0000 7f55f4517640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.725+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.203:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ec0722d0 con 0x7f55ec139450 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.730+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f55ec073550 con 0x7f55ec139450 2024-09-11T01:58:30.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.730+0000 7f55e2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.730+0000 7f55e2ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.749+0000 7f0f8efda640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.749+0000 7f0f8efda640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.749+0000 7f0f8efda640 10 monclient: monmap: 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.750082+0000 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.750082+0000 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.757 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 1 Processor -- start 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 1 -- start start 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 10 monclient: init 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 10 monclient: _add_conns ranks=[6,0,3,8,2,7,4,1,5] 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 10 monclient(hunting): picked mon.noname-d con 0x7f0f88138960 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 10 monclient(hunting): picked mon.noname-a con 0x7f0f88139450 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 10 monclient(hunting): picked mon.noname-g con 0x7f0f8813f620 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8809d030 con 0x7f0f88139450 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f7ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0f88139450 0x7f0f8813df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39922/0 (socket says 172.21.15.73:39922) 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f7ffff640 1 -- 172.21.15.73:0/280180458 learned_addr learned my addr 172.21.15.73:0/280180458 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 1 -- 172.21.15.73:0/280180458 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8809d310 con 0x7f0f8813f620 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 1 -- 172.21.15.73:0/280180458 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8806f770 con 0x7f0f88138960 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.750+0000 7f0f8efda640 10 monclient(hunting): authenticate will time out at 752.354871s 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586627354 0 0) 0x7f0f8809d030 con 0x7f0f88139450 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient(hunting): my global_id is 4383 2024-09-11T01:58:30.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f70003520 con 0x7f0f88139450 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312871801 0 0) 0x7f0f8806f770 con 0x7f0f88138960 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient(hunting): my global_id is 4308 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f8809d030 con 0x7f0f88138960 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3845971313 0 0) 0x7f0f70003520 con 0x7f0f88139450 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 >> v1:172.21.15.73:6792/0 conn(0x7f0f88138960 legacy=0x7f0f88138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 >> v1:172.21.15.203:6790/0 conn(0x7f0f8813f620 legacy=0x7f0f88141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 monclient: found mon.noname-a 2024-09-11T01:58:30.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f880a7360 con 0x7f0f88139450 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f78001830 con 0x7f0f88139450 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: dump: 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.761 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.762 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f8efda640 5 monclient: authenticate success, global_id 4383 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f8efda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f78001a50 con 0x7f0f88139450 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 1 -- 172.21.15.73:0/280180458 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f78001d40 con 0x7f0f88139450 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f7f7fe640 10 monclient: dump: 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.763 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f8efda640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7f0f8efda640 4 set_mon_vals no callback set 2024-09-11T01:58:30.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7fe092ae4640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7fe092ae4640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.751+0000 7fe092ae4640 10 monclient: monmap: 2024-09-11T01:58:30.765 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.765 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.765 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.752768+0000 2024-09-11T01:58:30.765 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.752768+0000 2024-09-11T01:58:30.765 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.765 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.752+0000 7f0a49fbb640 10 monclient: get_monmap_and_config 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.752+0000 7f0a49fbb640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.752+0000 7f0a49fbb640 10 monclient: monmap: 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:30.753110+0000 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:30.753110+0000 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.767 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.768 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.768 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.768 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.768 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.768 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.752+0000 7f0f8efda640 10 monclient: shutdown 2024-09-11T01:58:30.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.752+0000 7f0f8efda640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.752+0000 7f0f8efda640 1 -- 172.21.15.73:0/280180458 >> v1:172.21.15.73:6789/0 conn(0x7f0f88139450 legacy=0x7f0f8813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.752+0000 7f0f8efda640 1 -- 172.21.15.73:0/280180458 shutdown_connections 2024-09-11T01:58:30.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.752+0000 7fe092ae4640 1 Processor -- start 2024-09-11T01:58:30.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7f0f8efda640 1 -- 172.21.15.73:0/280180458 >> 172.21.15.73:0/280180458 conn(0x7f0f880a8050 msgr2=0x7f0f880a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7fe092ae4640 1 -- start start 2024-09-11T01:58:30.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7fe092ae4640 10 monclient: init 2024-09-11T01:58:30.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7f0a49fbb640 1 Processor -- start 2024-09-11T01:58:30.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7f0a49fbb640 1 -- start start 2024-09-11T01:58:30.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7f0a49fbb640 10 monclient: init 2024-09-11T01:58:30.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7f0f8efda640 1 -- 172.21.15.73:0/280180458 shutdown_connections 2024-09-11T01:58:30.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7f0f8efda640 1 -- 172.21.15.73:0/280180458 wait complete. 2024-09-11T01:58:30.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7fe092ae4640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.753+0000 7fe092ae4640 10 monclient: _add_conns ranks=[8,4,1,2,0,3,7,5,6] 2024-09-11T01:58:30.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe090880640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fe08c0698f0 0x7fe08c1336a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38862/0 (socket says 172.21.15.73:38862) 2024-09-11T01:58:30.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe090880640 1 -- 172.21.15.73:0/3370930753 learned_addr learned my addr 172.21.15.73:0/3370930753 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 10 monclient: _add_conns ranks=[0,3,2,1,4,8,7,5,6] 2024-09-11T01:58:30.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 10 monclient(hunting): picked mon.noname-a con 0x7f0a441379e0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:30.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0f8efda640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe092ae4640 10 monclient(hunting): picked mon.noname-e con 0x7fe08c0698f0 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:30.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a437fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0a441379e0 0x7f0a4409dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39936/0 (socket says 172.21.15.73:39936) 2024-09-11T01:58:30.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a437fe640 1 -- 172.21.15.73:0/2027274949 learned_addr learned my addr 172.21.15.73:0/2027274949 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe092ae4640 10 monclient(hunting): picked mon.noname-c con 0x7fe08c0a1470 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 10 monclient(hunting): picked mon.noname-g con 0x7f0a44137dc0 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 10 monclient(hunting): picked mon.noname-b con 0x7f0a44138210 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe092ae4640 10 monclient(hunting): picked mon.noname-f con 0x7fe08c133db0 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:30.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe092ae4640 1 -- 172.21.15.73:0/3370930753 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c076580 con 0x7fe08c133db0 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0f8efda640 10 monclient: monmap: 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.775 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.776 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe092ae4640 1 -- 172.21.15.73:0/3370930753 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c0a4a40 con 0x7fe08c0a1470 2024-09-11T01:58:30.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 1 -- 172.21.15.73:0/2027274949 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a4406cd00 con 0x7f0a441379e0 2024-09-11T01:58:30.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 1 -- 172.21.15.73:0/2027274949 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a4409d550 con 0x7f0a44138210 2024-09-11T01:58:30.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe092ae4640 1 -- 172.21.15.73:0/3370930753 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c0a0d00 con 0x7fe08c0698f0 2024-09-11T01:58:30.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 1 -- 172.21.15.73:0/2027274949 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a4409d830 con 0x7f0a44137dc0 2024-09-11T01:58:30.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a49fbb640 10 monclient(hunting): authenticate will time out at 752.358866s 2024-09-11T01:58:30.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0f8efda640 1 Processor -- start 2024-09-11T01:58:30.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1088188115 0 0) 0x7fe08c0a0d00 con 0x7fe08c0698f0 2024-09-11T01:58:30.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0f8efda640 1 -- start start 2024-09-11T01:58:30.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0f8efda640 10 monclient: init 2024-09-11T01:58:30.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe092ae4640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7fe092ae4640 10 monclient(hunting): authenticate will time out at 752.358978s 2024-09-11T01:58:30.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): my global_id is 4292 2024-09-11T01:58:30.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe07c003520 con 0x7fe08c0698f0 2024-09-11T01:58:30.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.754+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850284873 0 0) 0x7f0a34001110 con 0x7f0a441379e0 2024-09-11T01:58:30.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): my global_id is 4392 2024-09-11T01:58:30.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a2c003520 con 0x7f0a441379e0 2024-09-11T01:58:30.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354956614 0 0) 0x7f0a4409d830 con 0x7f0a44137dc0 2024-09-11T01:58:30.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254655533 0 0) 0x7fe08c0a4a40 con 0x7fe08c0a1470 2024-09-11T01:58:30.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): my global_id is 4360 2024-09-11T01:58:30.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08c0a0d00 con 0x7fe08c0a1470 2024-09-11T01:58:30.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 650601219 0 0) 0x7fe08c076580 con 0x7fe08c133db0 2024-09-11T01:58:30.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient(hunting): my global_id is 4303 2024-09-11T01:58:30.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08c0a4a40 con 0x7fe08c133db0 2024-09-11T01:58:30.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 10 monclient: _add_conns ranks=[2,5,4,0,3,1,7,8,6] 2024-09-11T01:58:30.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3235040716 0 0) 0x7fe07c003520 con 0x7fe08c0698f0 2024-09-11T01:58:30.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 >> v1:172.21.15.73:6791/0 conn(0x7fe08c0a1470 legacy=0x7fe08c13bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 >> v1:172.21.15.203:6789/0 conn(0x7fe08c133db0 legacy=0x7fe08c13f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 10 monclient(hunting): picked mon.noname-b con 0x7f0f88138960 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:30.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 monclient: found mon.noname-e 2024-09-11T01:58:30.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T01:58:30.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c0a0fe0 con 0x7fe08c0698f0 2024-09-11T01:58:30.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8cd76640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f0f88138960 0x7f0f88071730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41090/0 (socket says 172.21.15.73:41090) 2024-09-11T01:58:30.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 10 monclient(hunting): picked mon.noname-h con 0x7f0f88139450 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:30.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 10 monclient(hunting): picked mon.noname-c con 0x7f0f8813f620 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:30.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f88073380 con 0x7f0f88138960 2024-09-11T01:58:30.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f880726e0 con 0x7f0f8813f620 2024-09-11T01:58:30.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f880729c0 con 0x7f0f88139450 2024-09-11T01:58:30.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8efda640 10 monclient(hunting): authenticate will time out at 752.359972s 2024-09-11T01:58:30.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0f8cd76640 1 -- 172.21.15.73:0/991740948 learned_addr learned my addr 172.21.15.73:0/991740948 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): my global_id is 4350 2024-09-11T01:58:30.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe092ae4640 5 monclient: authenticate success, global_id 4292 2024-09-11T01:58:30.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe092ae4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe0800017b0 con 0x7fe08c0698f0 2024-09-11T01:58:30.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 10 monclient: dump: 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe080001a10 con 0x7fe08c0698f0 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe092ae4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 1 -- 172.21.15.73:0/3370930753 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe080004be0 con 0x7fe08c0698f0 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe092ae4640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe092ae4640 4 set_mon_vals no callback set 2024-09-11T01:58:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a34001110 con 0x7f0a44137dc0 2024-09-11T01:58:30.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:30.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7fe08b7fe640 10 monclient: dump: 2024-09-11T01:58:30.793 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.793 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.793 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.794 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.795 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914195973 0 0) 0x7f0a4409d550 con 0x7f0a44138210 2024-09-11T01:58:30.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551526092 0 0) 0x7f0f84001a50 con 0x7f0f88138960 2024-09-11T01:58:30.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): my global_id is 4313 2024-09-11T01:58:30.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f74003550 con 0x7f0f88138960 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143636595 0 0) 0x7f0f880729c0 con 0x7f0f88139450 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): my global_id is 4352 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f84001a50 con 0x7f0f88139450 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864568396 0 0) 0x7f0f880726e0 con 0x7f0f8813f620 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 10 monclient(hunting): my global_id is 4369 2024-09-11T01:58:30.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f880729c0 con 0x7f0f8813f620 2024-09-11T01:58:30.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient(hunting): my global_id is 4304 2024-09-11T01:58:30.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a4409d830 con 0x7f0a44138210 2024-09-11T01:58:30.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2932354045 0 0) 0x7f0a2c003520 con 0x7f0a441379e0 2024-09-11T01:58:30.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 >> v1:172.21.15.203:6790/0 conn(0x7f0a44137dc0 legacy=0x7f0a4413daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 >> v1:172.21.15.73:6790/0 conn(0x7f0a44138210 legacy=0x7f0a441411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 monclient: found mon.noname-a 2024-09-11T01:58:30.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.756+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1305933796 0 0) 0x7f0f84001a50 con 0x7f0f88139450 2024-09-11T01:58:30.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f880726e0 con 0x7f0f88139450 2024-09-11T01:58:30.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:30.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 795758138 0 0) 0x7f0f74003550 con 0x7f0f88138960 2024-09-11T01:58:30.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7fe092ae4640 10 monclient: shutdown 2024-09-11T01:58:30.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7fe092ae4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f84001a50 con 0x7f0f88138960 2024-09-11T01:58:30.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7fe092ae4640 1 -- 172.21.15.73:0/3370930753 >> v1:172.21.15.73:6793/0 conn(0x7fe08c0698f0 legacy=0x7fe08c1336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f780017f0 con 0x7f0f88139450 2024-09-11T01:58:30.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.802 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.803 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.803 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.803 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.803 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7fe092ae4640 1 -- 172.21.15.73:0/3370930753 shutdown_connections 2024-09-11T01:58:30.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a4406d5e0 con 0x7f0a441379e0 2024-09-11T01:58:30.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0a34001a00 con 0x7f0a441379e0 2024-09-11T01:58:30.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:30.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: dump: 2024-09-11T01:58:30.804 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.804 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.805 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a34001c90 con 0x7f0a441379e0 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 1 -- 172.21.15.73:0/2027274949 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0a34004c20 con 0x7f0a441379e0 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.755+0000 7f0a427fc640 10 monclient: dump: 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.806 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 661230371 0 0) 0x7f0f880729c0 con 0x7f0f8813f620 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f74003550 con 0x7f0f8813f620 2024-09-11T01:58:30.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f840035f0 con 0x7f0f88138960 2024-09-11T01:58:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0a49fbb640 5 monclient: authenticate success, global_id 4392 2024-09-11T01:58:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0a49fbb640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.808 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.809 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0a49fbb640 4 set_mon_vals no callback set 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 821344744 0 0) 0x7f0f880726e0 con 0x7f0f88139450 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 >> v1:172.21.15.73:6791/0 conn(0x7f0f8813f620 legacy=0x7f0f881d9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 >> v1:172.21.15.73:6790/0 conn(0x7f0f88138960 legacy=0x7f0f88071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 monclient: found mon.h 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f88072400 con 0x7f0f88139450 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f8efda640 5 monclient: authenticate success, global_id 4352 2024-09-11T01:58:30.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f8efda640 10 monclient: _renew_subs 2024-09-11T01:58:30.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f8efda640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:30.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.203:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f88071e40 con 0x7f0f88139450 2024-09-11T01:58:30.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7fe092ae4640 1 -- 172.21.15.73:0/3370930753 >> 172.21.15.73:0/3370930753 conn(0x7fe08c0a3d70 msgr2=0x7fe08c0a4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f8efda640 10 monclient: _renew_subs 2024-09-11T01:58:30.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7fe092ae4640 1 -- 172.21.15.73:0/3370930753 shutdown_connections 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f8efda640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.203:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f881db1d0 con 0x7f0f88139450 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f78001990 con 0x7f0f88139450 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f78001100 con 0x7f0f88139450 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7d7fa640 10 monclient: dump: 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.814 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.757+0000 7f0f7e7fc640 4 set_mon_vals no callback set 2024-09-11T01:58:30.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.758+0000 7fe092ae4640 1 -- 172.21.15.73:0/3370930753 wait complete. 2024-09-11T01:58:30.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.758+0000 7f0a49fbb640 10 monclient: shutdown 2024-09-11T01:58:30.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.758+0000 7f0a49fbb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.758+0000 7f0a49fbb640 1 -- 172.21.15.73:0/2027274949 >> v1:172.21.15.73:6789/0 conn(0x7f0a441379e0 legacy=0x7f0a4409dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.758+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f0f780115e0 con 0x7f0f88139450 2024-09-11T01:58:30.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.758+0000 7f0f8efda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.758+0000 7f0a49fbb640 1 -- 172.21.15.73:0/2027274949 shutdown_connections 2024-09-11T01:58:30.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.758+0000 7f0a49fbb640 1 -- 172.21.15.73:0/2027274949 >> 172.21.15.73:0/2027274949 conn(0x7f0a440a54d0 msgr2=0x7f0a440688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7fe092ae4640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7f0f8efda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7f0f8efda640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:30.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.203:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f68005080 con 0x7f0f88139450 2024-09-11T01:58:30.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7fe092ae4640 10 monclient: monmap: 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.820 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f0f7804e050 con 0x7f0f88139450 2024-09-11T01:58:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7f0a49fbb640 1 -- 172.21.15.73:0/2027274949 shutdown_connections 2024-09-11T01:58:30.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7f0a49fbb640 1 -- 172.21.15.73:0/2027274949 wait complete. 2024-09-11T01:58:30.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7f0f8cd76640 10 monclient: get_auth_request con 0x7f0f74040690 auth_method 0 2024-09-11T01:58:30.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.759+0000 7fe092ae4640 1 Processor -- start 2024-09-11T01:58:30.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.760+0000 7fe092ae4640 1 -- start start 2024-09-11T01:58:30.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.760+0000 7fe092ae4640 10 monclient: init 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.760+0000 7f0a49fbb640 10 monclient: build_initial_monmap 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.760+0000 7f0a49fbb640 10 monclient: monmap: 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:30.822 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:30.823 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:30.823 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:30.823 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:30.823 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:30.823 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:30.823 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:30.823 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.760+0000 7f0a49fbb640 1 Processor -- start 2024-09-11T01:58:30.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7fe092ae4640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7fe092ae4640 10 monclient: _add_conns ranks=[6,1,2,3,5,4,7,8,0] 2024-09-11T01:58:30.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7f0a49fbb640 1 -- start start 2024-09-11T01:58:30.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7f0a49fbb640 10 monclient: init 2024-09-11T01:58:30.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7fe090880640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fe08c0a1470 0x7fe08c0700d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:38188/0 (socket says 172.21.15.73:38188) 2024-09-11T01:58:30.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7fe090880640 1 -- 172.21.15.73:0/968289650 learned_addr learned my addr 172.21.15.73:0/968289650 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7fe092ae4640 10 monclient(hunting): picked mon.noname-d con 0x7fe08c0a1470 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7fe092ae4640 10 monclient(hunting): picked mon.noname-f con 0x7fe08c133db0 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:30.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7fe092ae4640 10 monclient(hunting): picked mon.noname-b con 0x7fe08c072d80 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:30.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c072060 con 0x7fe08c133db0 2024-09-11T01:58:30.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.761+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c132c00 con 0x7fe08c072d80 2024-09-11T01:58:30.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:30.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 10 monclient: _add_conns ranks=[7,6,8,1,3,5,2,0,4] 2024-09-11T01:58:30.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548057872 0 0) 0x7fe08c072060 con 0x7fe08c133db0 2024-09-11T01:58:30.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 10 monclient(hunting): picked mon.noname-i con 0x7f0a441379e0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:30.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c073990 con 0x7fe08c0a1470 2024-09-11T01:58:30.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 10 monclient(hunting): picked mon.noname-d con 0x7f0a44137dc0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 10 monclient(hunting): picked mon.noname-e con 0x7f0a44138210 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a44139910 con 0x7f0a44137dc0 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a42ffd640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f0a44137dc0 0x7f0a44135670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:38198/0 (socket says 172.21.15.73:38198) 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a42ffd640 1 -- 172.21.15.73:0/1466698533 learned_addr learned my addr 172.21.15.73:0/1466698533 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a440a68a0 con 0x7f0a441379e0 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a44139630 con 0x7f0a44138210 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 308898360 0 0) 0x7f0a44139910 con 0x7f0a44137dc0 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a49fbb640 10 monclient(hunting): authenticate will time out at 752.366954s 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a2bfff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.762+0000 7f0a2bfff640 10 monclient(hunting): my global_id is 4317 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a30003550 con 0x7f0a44137dc0 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370973980 0 0) 0x7f0a44139630 con 0x7f0a44138210 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): my global_id is 4301 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a44139910 con 0x7f0a44138210 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 454061584 0 0) 0x7f0a44139910 con 0x7f0a44138210 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a44139630 con 0x7f0a44138210 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0a3c001d70 con 0x7f0a44138210 2024-09-11T01:58:30.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): dump: 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.830 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe092ae4640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe092ae4640 10 monclient(hunting): authenticate will time out at 752.367492s 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): my global_id is 4312 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe070003520 con 0x7fe08c133db0 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1067737186 0 0) 0x7fe084001490 con 0x7fe08c072d80 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): my global_id is 4322 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08c072060 con 0x7fe08c072d80 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156531348 0 0) 0x7fe08c073990 con 0x7fe08c0a1470 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): my global_id is 4326 2024-09-11T01:58:30.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe084001490 con 0x7fe08c0a1470 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2336269672 0 0) 0x7fe08c072060 con 0x7fe08c072d80 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe08c073990 con 0x7fe08c072d80 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe084001f00 con 0x7fe08c072d80 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): dump: 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.833 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:30.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1453734410 0 0) 0x7f0a30003550 con 0x7f0a44137dc0 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a44139910 con 0x7f0a44137dc0 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0a38001b30 con 0x7f0a44137dc0 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient(hunting): dump: 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.835 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2736481714 0 0) 0x7f0a44139630 con 0x7f0a44138210 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 >> v1:172.21.15.203:6792/0 conn(0x7f0a441379e0 legacy=0x7f0a44134f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 >> v1:172.21.15.73:6792/0 conn(0x7f0a44137dc0 legacy=0x7f0a44135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 monclient: found mon.e 2024-09-11T01:58:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a441d69c0 con 0x7f0a44138210 2024-09-11T01:58:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7f0a2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.763+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 935022629 0 0) 0x7fe08c073990 con 0x7fe08c072d80 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 >> v1:172.21.15.73:6792/0 conn(0x7fe08c0a1470 legacy=0x7fe08c0700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 >> v1:172.21.15.203:6789/0 conn(0x7fe08c133db0 legacy=0x7fe08c0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 1 monclient: found mon.b 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c073c70 con 0x7fe08c072d80 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe084003c40 con 0x7fe08c072d80 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe084004130 con 0x7fe08c072d80 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe0897fa640 10 monclient: dump: 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.839 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe08affd640 4 set_mon_vals no callback set 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe092ae4640 5 monclient: authenticate success, global_id 4322 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe092ae4640 10 monclient: _renew_subs 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe092ae4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe08c070ef0 con 0x7fe08c072d80 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7f0a49fbb640 5 monclient: authenticate success, global_id 4301 2024-09-11T01:58:30.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7f0a49fbb640 10 monclient: _renew_subs 2024-09-11T01:58:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7f0a49fbb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a441d6c50 con 0x7f0a44138210 2024-09-11T01:58:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a3c002010 con 0x7f0a44138210 2024-09-11T01:58:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f0f78017360 con 0x7f0f88139450 2024-09-11T01:58:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7f0f7d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.764+0000 7f0f7d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:30.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a2bfff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:30.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0a3c004000 con 0x7f0a44138210 2024-09-11T01:58:30.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fe084010870 con 0x7fe08c072d80 2024-09-11T01:58:30.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.766+0000 7fe092ae4640 10 monclient: _renew_subs 2024-09-11T01:58:30.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:30.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.766+0000 7fe092ae4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:30.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.766+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe08c072470 con 0x7fe08c072d80 2024-09-11T01:58:30.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a2bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:30.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a2bfff640 10 monclient: dump: 2024-09-11T01:58:30.843 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:30.844 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:30.845 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:30.845 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:30.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f0a3c010740 con 0x7f0a44138210 2024-09-11T01:58:30.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a49fbb640 10 monclient: _renew_subs 2024-09-11T01:58:30.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.766+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7fe08404c390 con 0x7fe08c072d80 2024-09-11T01:58:30.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a49fbb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:30.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a441d7000 con 0x7f0a44138210 2024-09-11T01:58:30.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.765+0000 7f0a41ffb640 4 set_mon_vals no callback set 2024-09-11T01:58:30.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.766+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f0a3c04d400 con 0x7f0a44138210 2024-09-11T01:58:30.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.766+0000 7fe090880640 10 monclient: get_auth_request con 0x7fe07003fe10 auth_method 0 2024-09-11T01:58:30.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.766+0000 7f0a437fe640 10 monclient: get_auth_request con 0x7f0a300403e0 auth_method 0 2024-09-11T01:58:30.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.767+0000 7f0a49fbb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.767+0000 7f0a49fbb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.767+0000 7f0a49fbb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:30.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.767+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a440a6bf0 con 0x7f0a44138210 2024-09-11T01:58:30.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.767+0000 7fe092ae4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.767+0000 7fe092ae4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.768+0000 7fe092ae4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:30.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.768+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08c074a90 con 0x7fe08c072d80 2024-09-11T01:58:30.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.776+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f0a3c016810 con 0x7f0a44138210 2024-09-11T01:58:30.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.776+0000 7f0a2bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.776+0000 7f0a2bfff640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.777+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fe08c132c00 con 0x7fe08c072d80 2024-09-11T01:58:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.777+0000 7fe0897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:30.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.777+0000 7fe0897fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.933+0000 7f55f4517640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-11T01:58:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.933+0000 7f55f4517640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-11T01:58:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.933+0000 7f55f4517640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T01:58:30.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.933+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 --> v1:172.21.15.203:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f55ec0a3c40 con 0x7f55ec139450 2024-09-11T01:58:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.934+0000 7f55e2ffd640 1 -- 172.21.15.73:0/1796105091 <== mon.3 v1:172.21.15.203:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 2777258794) 0x7f55dc017490 con 0x7f55ec139450 2024-09-11T01:58:30.936 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-09-11T01:58:30.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.934+0000 7f55e2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-11T01:58:30.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.934+0000 7f55e2ffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.936+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 >> v1:172.21.15.203:6812/2311533528 conn(0x7f55d00406c0 legacy=0x7f55d0042b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.936+0000 7f55f4517640 10 monclient: shutdown 2024-09-11T01:58:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.936+0000 7f55f4517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.936+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 >> v1:172.21.15.203:6790/0 conn(0x7f55ec139450 legacy=0x7f55ec137af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.936+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 shutdown_connections 2024-09-11T01:58:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.936+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 >> 172.21.15.73:0/1796105091 conn(0x7f55ec0a8050 msgr2=0x7f55ec141bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.936+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 shutdown_connections 2024-09-11T01:58:30.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.936+0000 7f55f4517640 1 -- 172.21.15.73:0/1796105091 wait complete. 2024-09-11T01:58:30.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-09-11T01:58:30.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.957+0000 7f0f8efda640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-11T01:58:30.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.957+0000 7f0f8efda640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-11T01:58:30.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.957+0000 7f0f8efda640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T01:58:30.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.957+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 --> v1:172.21.15.203:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0f68005370 con 0x7f0f88139450 2024-09-11T01:58:30.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.957+0000 7f0f7d7fa640 1 -- 172.21.15.73:0/991740948 <== mon.5 v1:172.21.15.203:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 2194451396) 0x7f0f78016c60 con 0x7f0f88139450 2024-09-11T01:58:30.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.957+0000 7f0f7d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-11T01:58:30.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.957+0000 7f0f7d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:30.960 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-09-11T01:58:30.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.960+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 >> v1:172.21.15.203:6812/2311533528 conn(0x7f0f74040690 legacy=0x7f0f74042b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.960+0000 7f0f8efda640 10 monclient: shutdown 2024-09-11T01:58:30.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.960+0000 7f0f8efda640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:30.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.960+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 >> v1:172.21.15.203:6791/0 conn(0x7f0f88139450 legacy=0x7f0f881d6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:30.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.960+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 shutdown_connections 2024-09-11T01:58:30.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.960+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 >> 172.21.15.73:0/991740948 conn(0x7f0f880a8050 msgr2=0x7f0f880a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:30.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.960+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 shutdown_connections 2024-09-11T01:58:30.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:30.960+0000 7f0f8efda640 1 -- 172.21.15.73:0/991740948 wait complete. 2024-09-11T01:58:30.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2024-09-11T01:58:31.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.036+0000 7fbebb033640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-11T01:58:31.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.036+0000 7fbebb033640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-11T01:58:31.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.036+0000 7fbebb033640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:31.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.036+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbe94005370 con 0x7fbeb4139450 2024-09-11T01:58:31.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.036+0000 7fbeb17fa640 1 -- 172.21.15.73:0/758644685 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 1444633209) 0x7fbea0016ed0 con 0x7fbeb4139450 2024-09-11T01:58:31.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.036+0000 7fbeb17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-11T01:58:31.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.036+0000 7fbeb17fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:31.039 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2024-09-11T01:58:31.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.040+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 >> v1:172.21.15.203:6812/2311533528 conn(0x7fbe9803ffa0 legacy=0x7fbe98042460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:31.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.040+0000 7fbebb033640 10 monclient: shutdown 2024-09-11T01:58:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.040+0000 7fbebb033640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.040+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 >> v1:172.21.15.73:6791/0 conn(0x7fbeb4139450 legacy=0x7fbeb41d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.040+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 shutdown_connections 2024-09-11T01:58:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.040+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 >> 172.21.15.73:0/758644685 conn(0x7fbeb40a8050 msgr2=0x7fbeb40a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.040+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 shutdown_connections 2024-09-11T01:58:31.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.040+0000 7fbebb033640 1 -- 172.21.15.73:0/758644685 wait complete. 2024-09-11T01:58:31.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.1 2024-09-11T01:58:31.056 DEBUG:teuthology.parallel:result is None 2024-09-11T01:58:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.079+0000 7fa0f1ffb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-11T01:58:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.079+0000 7fa0f1ffb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-11T01:58:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.079+0000 7fa0f1ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.079+0000 7fa0f1ffb640 1 -- 172.21.15.73:0/2492758880 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa10c13c580 con 0x7fa10c13f620 2024-09-11T01:58:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.079+0000 7fa0f3fff640 1 -- 172.21.15.73:0/2492758880 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 532354816) 0x7fa104017200 con 0x7fa10c13f620 2024-09-11T01:58:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.079+0000 7fa0f3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-11T01:58:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.079+0000 7fa0f3fff640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:31.082 INFO:teuthology.orchestra.run.smithi073.stdout:51539607557 2024-09-11T01:58:31.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.083+0000 7fa0f1ffb640 1 -- 172.21.15.73:0/2492758880 >> v1:172.21.15.203:6812/2311533528 conn(0x7fa0f803ffb0 legacy=0x7fa0f8042470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.083+0000 7fa0f1ffb640 10 monclient: shutdown 2024-09-11T01:58:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.083+0000 7fa0f1ffb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.083+0000 7fa0f1ffb640 1 -- 172.21.15.73:0/2492758880 >> v1:172.21.15.73:6789/0 conn(0x7fa10c13f620 legacy=0x7fa10c1d5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.083+0000 7fa0f1ffb640 1 -- 172.21.15.73:0/2492758880 shutdown_connections 2024-09-11T01:58:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.083+0000 7fa0f1ffb640 1 -- 172.21.15.73:0/2492758880 >> 172.21.15.73:0/2492758880 conn(0x7fa10c0a8050 msgr2=0x7fa10c141a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.083+0000 7fa0f1ffb640 1 -- 172.21.15.73:0/2492758880 shutdown_connections 2024-09-11T01:58:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.083+0000 7fa0f1ffb640 1 -- 172.21.15.73:0/2492758880 wait complete. 2024-09-11T01:58:31.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607557 got 51539607557 for osd.3 2024-09-11T01:58:31.095 DEBUG:teuthology.parallel:result is None 2024-09-11T01:58:31.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.109+0000 7fe092ae4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-11T01:58:31.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.109+0000 7fe092ae4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-11T01:58:31.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.109+0000 7fe092ae4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:31.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.109+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe08c073710 con 0x7fe08c072d80 2024-09-11T01:58:31.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.109+0000 7fe0897fa640 1 -- 172.21.15.73:0/968289650 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 3056272221) 0x7fe084016800 con 0x7fe08c072d80 2024-09-11T01:58:31.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.109+0000 7fe0897fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-11T01:58:31.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.109+0000 7fe0897fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:31.112 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-09-11T01:58:31.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.111+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 >> v1:172.21.15.203:6812/2311533528 conn(0x7fe07003fe10 legacy=0x7fe0700422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:31.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.111+0000 7fe092ae4640 10 monclient: shutdown 2024-09-11T01:58:31.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.111+0000 7fe092ae4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:31.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.111+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 >> v1:172.21.15.73:6790/0 conn(0x7fe08c072d80 legacy=0x7fe08c1d39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:31.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.112+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 shutdown_connections 2024-09-11T01:58:31.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.112+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 >> 172.21.15.73:0/968289650 conn(0x7fe08c0a3d70 msgr2=0x7fe08c126b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:31.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.112+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 shutdown_connections 2024-09-11T01:58:31.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.112+0000 7fe092ae4640 1 -- 172.21.15.73:0/968289650 wait complete. 2024-09-11T01:58:31.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-09-11T01:58:31.124 DEBUG:teuthology.parallel:result is None 2024-09-11T01:58:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.128+0000 7f0a49fbb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-11T01:58:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.128+0000 7f0a49fbb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-11T01:58:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.128+0000 7f0a49fbb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T01:58:31.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.128+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0a4406e0e0 con 0x7f0a44138210 2024-09-11T01:58:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.129+0000 7f0a2bfff640 1 -- 172.21.15.73:0/1466698533 <== mon.8 v1:172.21.15.73:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 3427191320) 0x7f0a3c016110 con 0x7f0a44138210 2024-09-11T01:58:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.129+0000 7f0a2bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-11T01:58:31.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.129+0000 7f0a2bfff640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:31.131 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-09-11T01:58:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.131+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 >> v1:172.21.15.203:6812/2311533528 conn(0x7f0a300403e0 legacy=0x7f0a300428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.131+0000 7f0a49fbb640 10 monclient: shutdown 2024-09-11T01:58:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.131+0000 7f0a49fbb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.131+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 >> v1:172.21.15.73:6793/0 conn(0x7f0a44138210 legacy=0x7f0a44135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.131+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 shutdown_connections 2024-09-11T01:58:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.131+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 >> 172.21.15.73:0/1466698533 conn(0x7f0a440a54d0 msgr2=0x7f0a44130a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:31.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.131+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 shutdown_connections 2024-09-11T01:58:31.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:31.131+0000 7f0a49fbb640 1 -- 172.21.15.73:0/1466698533 wait complete. 2024-09-11T01:58:31.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-09-11T01:58:31.143 DEBUG:teuthology.parallel:result is None 2024-09-11T01:58:31.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T01:58:31.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T01:58:32.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.067+0000 7f167dfb4640 10 monclient: get_monmap_and_config 2024-09-11T01:58:32.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.067+0000 7f167dfb4640 10 monclient: build_initial_monmap 2024-09-11T01:58:32.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.067+0000 7f167dfb4640 10 monclient: monmap: 2024-09-11T01:58:32.069 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:32.068700+0000 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:32.068700+0000 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:32.070 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:32.071 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:32.071 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.068+0000 7f167dfb4640 1 Processor -- start 2024-09-11T01:58:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.068+0000 7f167dfb4640 1 -- start start 2024-09-11T01:58:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.068+0000 7f167dfb4640 10 monclient: init 2024-09-11T01:58:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:32.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 10 monclient: _add_conns ranks=[1,2,3,4,0,7,6,8,5] 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 10 monclient(hunting): picked mon.noname-f con 0x7f1678138960 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 10 monclient(hunting): picked mon.noname-b con 0x7f1678139450 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 10 monclient(hunting): picked mon.noname-g con 0x7f167813f620 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167809d030 con 0x7f1678138960 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167809d310 con 0x7f1678139450 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167806f770 con 0x7f167813f620 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 10 monclient(hunting): authenticate will time out at 753.673288s 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f1676ffd640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f1678139450 0x7f167813df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53604/0 (socket says 172.21.15.73:53604) 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f1676ffd640 1 -- 172.21.15.73:0/2154927929 learned_addr learned my addr 172.21.15.73:0/2154927929 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:32.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1568449361 0 0) 0x7f167809d310 con 0x7f1678139450 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): my global_id is 4331 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1660003520 con 0x7f1678139450 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087205723 0 0) 0x7f167806f770 con 0x7f167813f620 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): my global_id is 4359 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f167809d310 con 0x7f167813f620 2024-09-11T01:58:32.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49039400 0 0) 0x7f167809d030 con 0x7f1678138960 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient(hunting): my global_id is 4321 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f167806f770 con 0x7f1678138960 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2059644327 0 0) 0x7f1660003520 con 0x7f1678139450 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 >> v1:172.21.15.203:6790/0 conn(0x7f167813f620 legacy=0x7f1678141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 >> v1:172.21.15.203:6789/0 conn(0x7f1678138960 legacy=0x7f1678138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 monclient: found mon.noname-b 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:32.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16780a7360 con 0x7f1678139450 2024-09-11T01:58:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f166c001830 con 0x7f1678139450 2024-09-11T01:58:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 5 monclient: authenticate success, global_id 4331 2024-09-11T01:58:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:32.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f16767fc640 10 monclient: dump: 2024-09-11T01:58:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.084 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.069+0000 7f167dfb4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:32.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f166c001a50 con 0x7f1678139450 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f16767fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f16767fc640 1 -- 172.21.15.73:0/2154927929 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f166c004be0 con 0x7f1678139450 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f167dfb4640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f167dfb4640 4 set_mon_vals no callback set 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f16767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f16767fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f16767fc640 10 monclient: dump: 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.086 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.087 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.088 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f167dfb4640 10 monclient: shutdown 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f167dfb4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f167dfb4640 1 -- 172.21.15.73:0/2154927929 >> v1:172.21.15.73:6790/0 conn(0x7f1678139450 legacy=0x7f167813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f167dfb4640 1 -- 172.21.15.73:0/2154927929 shutdown_connections 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f167dfb4640 1 -- 172.21.15.73:0/2154927929 >> 172.21.15.73:0/2154927929 conn(0x7f16780a8050 msgr2=0x7f16780a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f167dfb4640 1 -- 172.21.15.73:0/2154927929 shutdown_connections 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.070+0000 7f167dfb4640 1 -- 172.21.15.73:0/2154927929 wait complete. 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.071+0000 7f167dfb4640 10 monclient: build_initial_monmap 2024-09-11T01:58:32.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.071+0000 7f167dfb4640 10 monclient: monmap: 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:32.090 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.071+0000 7f167dfb4640 1 Processor -- start 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.071+0000 7f167dfb4640 1 -- start start 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.071+0000 7f167dfb4640 10 monclient: init 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 10 monclient: _add_conns ranks=[8,5,2,6,0,4,3,1,7] 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 10 monclient(hunting): picked mon.noname-e con 0x7f1678138960 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 10 monclient(hunting): picked mon.noname-h con 0x7f1678139450 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 10 monclient(hunting): picked mon.noname-b con 0x7f167813f620 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167813ace0 con 0x7f167813f620 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167813eec0 con 0x7f1678139450 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16780a1c60 con 0x7f1678138960 2024-09-11T01:58:32.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f167dfb4640 10 monclient(hunting): authenticate will time out at 753.676502s 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f16777fe640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f1678138960 0x7f1678137c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:37172/0 (socket says 172.21.15.73:37172) 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f16777fe640 1 -- 172.21.15.73:0/1118079163 learned_addr learned my addr 172.21.15.73:0/1118079163 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f1677fff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f167813f620 0x7f16781d5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53608/0 (socket says 172.21.15.73:53608) 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955117057 0 0) 0x7f167813ace0 con 0x7f167813f620 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): my global_id is 4340 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1664003520 con 0x7f167813f620 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156558905 0 0) 0x7f16780a1c60 con 0x7f1678138960 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): my global_id is 4310 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f167813ace0 con 0x7f1678138960 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134184391 0 0) 0x7f167813eec0 con 0x7f1678139450 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 10 monclient(hunting): my global_id is 4361 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.072+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16780a1c60 con 0x7f1678139450 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3535650061 0 0) 0x7f1664003520 con 0x7f167813f620 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f167813eec0 con 0x7f167813f620 2024-09-11T01:58:32.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1670001c70 con 0x7f167813f620 2024-09-11T01:58:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): dump: 2024-09-11T01:58:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.094 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3166341044 0 0) 0x7f167813ace0 con 0x7f1678138960 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1664003520 con 0x7f1678138960 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1668001b90 con 0x7f1678138960 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): dump: 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.096 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2017219276 0 0) 0x7f16780a1c60 con 0x7f1678139450 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f167813ace0 con 0x7f1678139450 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f166c004b20 con 0x7f1678139450 2024-09-11T01:58:32.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient(hunting): dump: 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.098 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2084715520 0 0) 0x7f167813eec0 con 0x7f167813f620 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 >> v1:172.21.15.73:6793/0 conn(0x7f1678138960 legacy=0x7f1678137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 >> v1:172.21.15.203:6791/0 conn(0x7f1678139450 legacy=0x7f16781d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 monclient: found mon.b 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167813c130 con 0x7f167813f620 2024-09-11T01:58:32.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient: _finish_auth 0 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f167dfb4640 5 monclient: authenticate success, global_id 4340 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f167dfb4640 10 monclient: _renew_subs 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f167dfb4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16780a1510 con 0x7f167813f620 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f167dfb4640 10 monclient: _renew_subs 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f167dfb4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f167813b3b0 con 0x7f167813f620 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1670003990 con 0x7f167813f620 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:32.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1670003f40 con 0x7f167813f620 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f1675ffb640 4 set_mon_vals no callback set 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.073+0000 7f165ffff640 10 monclient: dump: 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.101 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.074+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f16700040e0 con 0x7f167813f620 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.074+0000 7f167dfb4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.074+0000 7f167dfb4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.074+0000 7f167dfb4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.074+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1658005080 con 0x7f167813f620 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.074+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f167004e410 con 0x7f167813f620 2024-09-11T01:58:32.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.075+0000 7f16777fe640 10 monclient: get_auth_request con 0x7f1664040730 auth_method 0 2024-09-11T01:58:32.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.079+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f1670017780 con 0x7f167813f620 2024-09-11T01:58:32.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.079+0000 7f165ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.079+0000 7f165ffff640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:32.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.104+0000 7f9cb630e640 10 monclient: get_monmap_and_config 2024-09-11T01:58:32.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.104+0000 7f9cb630e640 10 monclient: build_initial_monmap 2024-09-11T01:58:32.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.105+0000 7f9cb630e640 10 monclient: monmap: 2024-09-11T01:58:32.106 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:32.105870+0000 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:32.105870+0000 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:32.107 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:32.108 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:32.108 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.105+0000 7f9cb630e640 1 Processor -- start 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.105+0000 7f9cb630e640 1 -- start start 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.105+0000 7f9cb630e640 10 monclient: init 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 10 monclient: _add_conns ranks=[3,2,5,6,4,1,8,0,7] 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 10 monclient(hunting): picked mon.noname-g con 0x7f9cb0138960 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 10 monclient(hunting): picked mon.noname-b con 0x7f9cb0139450 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 10 monclient(hunting): picked mon.noname-h con 0x7f9cb013f620 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb009d030 con 0x7f9cb0139450 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb009d310 con 0x7f9cb0138960 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb006f770 con 0x7f9cb013f620 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:32.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 10 monclient(hunting): authenticate will time out at 753.710370s 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caf7fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f9cb0139450 0x7f9cb013df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53610/0 (socket says 172.21.15.73:53610) 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caf7fe640 1 -- 172.21.15.73:0/2026955833 learned_addr learned my addr 172.21.15.73:0/2026955833 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 1 -- 172.21.15.73:0/2026955833 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801361753 0 0) 0x7f9cb009d030 con 0x7f9cb0139450 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient(hunting): my global_id is 4349 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 1 -- 172.21.15.73:0/2026955833 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c9c003520 con 0x7f9cb0139450 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 1 -- 172.21.15.73:0/2026955833 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3855781557 0 0) 0x7f9c9c003520 con 0x7f9cb0139450 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 1 -- 172.21.15.73:0/2026955833 >> v1:172.21.15.203:6791/0 conn(0x7f9cb013f620 legacy=0x7f9cb0141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 1 -- 172.21.15.73:0/2026955833 >> v1:172.21.15.203:6790/0 conn(0x7f9cb0138960 legacy=0x7f9cb0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 1 monclient: found mon.noname-b 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 1 -- 172.21.15.73:0/2026955833 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb00a7360 con 0x7f9cb0139450 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 1 -- 172.21.15.73:0/2026955833 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9c98001830 con 0x7f9cb0139450 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 5 monclient: authenticate success, global_id 4349 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9cb630e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:32.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.106+0000 7f9caeffd640 10 monclient: dump: 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.114 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9caeffd640 1 -- 172.21.15.73:0/2026955833 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c98001a50 con 0x7f9cb0139450 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9caeffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9caeffd640 1 -- 172.21.15.73:0/2026955833 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9c98001d40 con 0x7f9cb0139450 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9caeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9caeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9caeffd640 10 monclient: dump: 2024-09-11T01:58:32.115 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.116 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 4 set_mon_vals no callback set 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 10 monclient: shutdown 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 1 -- 172.21.15.73:0/2026955833 >> v1:172.21.15.73:6790/0 conn(0x7f9cb0139450 legacy=0x7f9cb013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 1 -- 172.21.15.73:0/2026955833 shutdown_connections 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 1 -- 172.21.15.73:0/2026955833 >> 172.21.15.73:0/2026955833 conn(0x7f9cb00a8050 msgr2=0x7f9cb00a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 1 -- 172.21.15.73:0/2026955833 shutdown_connections 2024-09-11T01:58:32.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.107+0000 7f9cb630e640 1 -- 172.21.15.73:0/2026955833 wait complete. 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.108+0000 7f9cb630e640 10 monclient: build_initial_monmap 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.108+0000 7f9cb630e640 10 monclient: monmap: 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:32.118 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:32.119 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.109+0000 7f9cb630e640 1 Processor -- start 2024-09-11T01:58:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.109+0000 7f9cb630e640 1 -- start start 2024-09-11T01:58:32.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.109+0000 7f9cb630e640 10 monclient: init 2024-09-11T01:58:32.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 10 monclient: _add_conns ranks=[3,4,1,8,0,7,2,6,5] 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 10 monclient(hunting): picked mon.noname-g con 0x7f9cb0138960 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 10 monclient(hunting): picked mon.noname-c con 0x7f9cb0139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 10 monclient(hunting): picked mon.noname-f con 0x7f9cb013f620 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb0138d40 con 0x7f9cb013f620 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb013c860 con 0x7f9cb0138960 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cb013cb40 con 0x7f9cb0139450 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 10 monclient(hunting): authenticate will time out at 753.714197s 2024-09-11T01:58:32.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9caf7fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f9cb0139450 0x7f9cb01d2730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49250/0 (socket says 172.21.15.73:49250) 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9caf7fe640 1 -- 172.21.15.73:0/3726818351 learned_addr learned my addr 172.21.15.73:0/3726818351 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408694431 0 0) 0x7f9cb013cb40 con 0x7f9cb0139450 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): my global_id is 4378 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c90003520 con 0x7f9cb0139450 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1849485338 0 0) 0x7f9cb013c860 con 0x7f9cb0138960 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): my global_id is 4377 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb013cb40 con 0x7f9cb0138960 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3002299793 0 0) 0x7f9c90003520 con 0x7f9cb0139450 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cb013c860 con 0x7f9cb0139450 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077166907 0 0) 0x7f9cb0138d40 con 0x7f9cb013f620 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): my global_id is 4330 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c90003520 con 0x7f9cb013f620 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9c980017f0 con 0x7f9cb0139450 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): dump: 2024-09-11T01:58:32.125 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.126 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.126 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.126 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.126 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.126 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.126 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.126 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.126 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.126 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3331375752 0 0) 0x7f9cb013cb40 con 0x7f9cb0138960 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cb0138d40 con 0x7f9cb0138960 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1296582541 0 0) 0x7f9cb013c860 con 0x7f9cb0139450 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 >> v1:172.21.15.203:6790/0 conn(0x7f9cb0138960 legacy=0x7f9cb013a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 >> v1:172.21.15.203:6789/0 conn(0x7f9cb013f620 legacy=0x7f9cb01d5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 monclient: found mon.c 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb013eae0 con 0x7f9cb0139450 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cacff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 5 monclient: authenticate success, global_id 4378 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 10 monclient: _renew_subs 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.110+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb013a8a0 con 0x7f9cb0139450 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cb630e640 10 monclient: _renew_subs 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cb630e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:32.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9cb00a12f0 con 0x7f9cb0139450 2024-09-11T01:58:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c98001d00 con 0x7f9cb0139450 2024-09-11T01:58:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cacff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9c98004fb0 con 0x7f9cb0139450 2024-09-11T01:58:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cacff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cae7fc640 4 set_mon_vals no callback set 2024-09-11T01:58:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cacff9640 10 monclient: dump: 2024-09-11T01:58:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.129 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.130 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9c980116f0 con 0x7f9cb0139450 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.111+0000 7f9cb630e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.112+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1298350643 0 0) 0x7f9c9804e380 con 0x7f9cb0139450 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.112+0000 7f9cb630e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.112+0000 7f9cb630e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:32.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.112+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c94005080 con 0x7f9cb0139450 2024-09-11T01:58:32.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.112+0000 7f9caffff640 10 monclient: get_auth_request con 0x7f9c90040110 auth_method 0 2024-09-11T01:58:32.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.116+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f9c98017690 con 0x7f9cb0139450 2024-09-11T01:58:32.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.116+0000 7f9cacff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.116+0000 7f9cacff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.264+0000 7f167dfb4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-11T01:58:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.264+0000 7f167dfb4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-11T01:58:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.264+0000 7f167dfb4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.264+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1658005370 con 0x7f167813f620 2024-09-11T01:58:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.265+0000 7f165ffff640 1 -- 172.21.15.73:0/1118079163 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 3756282479) 0x7f1670017080 con 0x7f167813f620 2024-09-11T01:58:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.265+0000 7f165ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-11T01:58:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.265+0000 7f165ffff640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:32.267 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2024-09-11T01:58:32.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.267+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 >> v1:172.21.15.203:6812/2311533528 conn(0x7f1664040730 legacy=0x7f1664042bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.267+0000 7f167dfb4640 10 monclient: shutdown 2024-09-11T01:58:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.267+0000 7f167dfb4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.267+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 >> v1:172.21.15.73:6790/0 conn(0x7f167813f620 legacy=0x7f16781d5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.267+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 shutdown_connections 2024-09-11T01:58:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.267+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 >> 172.21.15.73:0/1118079163 conn(0x7f16780a8050 msgr2=0x7f16780a4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.267+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 shutdown_connections 2024-09-11T01:58:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.267+0000 7f167dfb4640 1 -- 172.21.15.73:0/1118079163 wait complete. 2024-09-11T01:58:32.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-11T01:58:32.280 DEBUG:teuthology.parallel:result is None 2024-09-11T01:58:32.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.299+0000 7f9cb630e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-11T01:58:32.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.299+0000 7f9cb630e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-11T01:58:32.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.299+0000 7f9cb630e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:32.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.299+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9c94005370 con 0x7f9cb0139450 2024-09-11T01:58:32.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.299+0000 7f9cacff9640 1 -- 172.21.15.73:0/3726818351 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 3056272221) 0x7f9c98020460 con 0x7f9cb0139450 2024-09-11T01:58:32.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.299+0000 7f9cacff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-11T01:58:32.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.299+0000 7f9cacff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:32.466 INFO:teuthology.orchestra.run.smithi073.stdout:55834574852 2024-09-11T01:58:32.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.301+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9c90040110 legacy=0x7f9c900425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.301+0000 7f9cb630e640 10 monclient: shutdown 2024-09-11T01:58:32.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.301+0000 7f9cb630e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:32.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.301+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 >> v1:172.21.15.73:6791/0 conn(0x7f9cb0139450 legacy=0x7f9cb01d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.301+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 shutdown_connections 2024-09-11T01:58:32.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.301+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 >> 172.21.15.73:0/3726818351 conn(0x7f9cb00a8050 msgr2=0x7f9cb0141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:32.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.301+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 shutdown_connections 2024-09-11T01:58:32.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.301+0000 7f9cb630e640 1 -- 172.21.15.73:0/3726818351 wait complete. 2024-09-11T01:58:32.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-09-11T01:58:32.468 DEBUG:teuthology.parallel:result is None 2024-09-11T01:58:32.469 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T01:58:32.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.608+0000 7f30b7047640 10 monclient: get_monmap_and_config 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.608+0000 7f30b7047640 10 monclient: build_initial_monmap 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.608+0000 7f30b7047640 10 monclient: monmap: 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:32.609278+0000 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:32.609278+0000 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:32.610 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:32.611 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:32.611 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 1 Processor -- start 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 1 -- start start 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 10 monclient: init 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 10 monclient: _add_conns ranks=[7,3,2,0,4,5,1,8,6] 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 10 monclient(hunting): picked mon.noname-i con 0x7f30b0138d40 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 10 monclient(hunting): picked mon.noname-g con 0x7f30b00a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 10 monclient(hunting): picked mon.noname-b con 0x7f30b013f350 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b009ca00 con 0x7f30b013f350 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b00a7070 con 0x7f30b00a72f0 2024-09-11T01:58:32.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b009cee0 con 0x7f30b0138d40 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b7047640 10 monclient(hunting): authenticate will time out at 754.213684s 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b55e4640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f30b013f350 0x7f30b0141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53616/0 (socket says 172.21.15.73:53616) 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.609+0000 7f30b55e4640 1 -- 172.21.15.73:0/1897995041 learned_addr learned my addr 172.21.15.73:0/1897995041 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 -- 172.21.15.73:0/1897995041 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995583708 0 0) 0x7f30b009ca00 con 0x7f30b013f350 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient(hunting): my global_id is 4358 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 -- 172.21.15.73:0/1897995041 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30a0003520 con 0x7f30b013f350 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 -- 172.21.15.73:0/1897995041 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3481975087 0 0) 0x7f30a0003520 con 0x7f30b013f350 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 -- 172.21.15.73:0/1897995041 >> v1:172.21.15.203:6792/0 conn(0x7f30b0138d40 legacy=0x7f30b0139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 -- 172.21.15.73:0/1897995041 >> v1:172.21.15.203:6790/0 conn(0x7f30b00a72f0 legacy=0x7f30b013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 monclient: found mon.noname-b 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 -- 172.21.15.73:0/1897995041 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b009d1c0 con 0x7f30b013f350 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 -- 172.21.15.73:0/1897995041 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f30a8001bd0 con 0x7f30b013f350 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30b7047640 5 monclient: authenticate success, global_id 4358 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30b7047640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:32.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: dump: 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.620 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30b7047640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 -- 172.21.15.73:0/1897995041 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f30a8001df0 con 0x7f30b013f350 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 1 -- 172.21.15.73:0/1897995041 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f30a8004f60 con 0x7f30b013f350 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30b7047640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30b7047640 4 set_mon_vals no callback set 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30af7fe640 10 monclient: dump: 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.622 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30b7047640 10 monclient: shutdown 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30b7047640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.610+0000 7f30b7047640 1 -- 172.21.15.73:0/1897995041 >> v1:172.21.15.73:6790/0 conn(0x7f30b013f350 legacy=0x7f30b0141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.611+0000 7f30b7047640 1 -- 172.21.15.73:0/1897995041 shutdown_connections 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.611+0000 7f30b7047640 1 -- 172.21.15.73:0/1897995041 >> 172.21.15.73:0/1897995041 conn(0x7f30b00a8050 msgr2=0x7f30b00a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.611+0000 7f30b7047640 1 -- 172.21.15.73:0/1897995041 shutdown_connections 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.611+0000 7f30b7047640 1 -- 172.21.15.73:0/1897995041 wait complete. 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.611+0000 7f30b7047640 10 monclient: build_initial_monmap 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.611+0000 7f30b7047640 10 monclient: monmap: 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:32.623 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:32.624 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.611+0000 7f30b7047640 1 Processor -- start 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.611+0000 7f30b7047640 1 -- start start 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.611+0000 7f30b7047640 10 monclient: init 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 10 monclient: _add_conns ranks=[4,1,5,3,0,7,6,8,2] 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 10 monclient(hunting): picked mon.noname-c con 0x7f30b00a72f0 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 10 monclient(hunting): picked mon.noname-f con 0x7f30b0138d40 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 10 monclient(hunting): picked mon.noname-h con 0x7f30b013f350 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b009ffe0 con 0x7f30b0138d40 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b00a1980 con 0x7f30b00a72f0 2024-09-11T01:58:32.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b009fa60 con 0x7f30b013f350 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b7047640 10 monclient(hunting): authenticate will time out at 754.216617s 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b4de3640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f30b00a72f0 0x7f30b009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49262/0 (socket says 172.21.15.73:49262) 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30b4de3640 1 -- 172.21.15.73:0/1982829811 learned_addr learned my addr 172.21.15.73:0/1982829811 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399257470 0 0) 0x7f30b00a1980 con 0x7f30b00a72f0 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30ad7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30ad7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30ad7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30ad7fa640 10 monclient(hunting): my global_id is 4387 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.612+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3094003520 con 0x7f30b00a72f0 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084876606 0 0) 0x7f30b009fa60 con 0x7f30b013f350 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): my global_id is 4379 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30b00a1980 con 0x7f30b013f350 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513629867 0 0) 0x7f30b009ffe0 con 0x7f30b0138d40 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): my global_id is 4339 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30b009fa60 con 0x7f30b0138d40 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2249518181 0 0) 0x7f3094003520 con 0x7f30b00a72f0 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30b009ffe0 con 0x7f30b00a72f0 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f30a4001af0 con 0x7f30b00a72f0 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:32.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): dump: 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.628 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2379471136 0 0) 0x7f30b009ffe0 con 0x7f30b00a72f0 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 >> v1:172.21.15.203:6791/0 conn(0x7f30b013f350 legacy=0x7f30b01d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 >> v1:172.21.15.203:6789/0 conn(0x7f30b0138d40 legacy=0x7f30b009f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 monclient: found mon.c 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b013e850 con 0x7f30b00a72f0 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:32.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30b7047640 5 monclient: authenticate success, global_id 4387 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30b7047640 10 monclient: _renew_subs 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30b7047640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f30b01429f0 con 0x7f30b00a72f0 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30b7047640 10 monclient: _renew_subs 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30b7047640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f30b00a0460 con 0x7f30b00a72f0 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f30a40038c0 con 0x7f30b00a72f0 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f30a4003ef0 con 0x7f30b00a72f0 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30aeffd640 4 set_mon_vals no callback set 2024-09-11T01:58:32.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.613+0000 7f30ad7fa640 10 monclient: dump: 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.631 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.632 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.632 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.632 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.614+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f30a4004090 con 0x7f30b00a72f0 2024-09-11T01:58:32.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.614+0000 7f30b7047640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.614+0000 7f30b7047640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.614+0000 7f30b7047640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:32.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.614+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3090005080 con 0x7f30b00a72f0 2024-09-11T01:58:32.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.614+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7f30a404e200 con 0x7f30b00a72f0 2024-09-11T01:58:32.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.614+0000 7f30affff640 10 monclient: get_auth_request con 0x7f3094040000 auth_method 0 2024-09-11T01:58:32.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.618+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f30a4017590 con 0x7f30b00a72f0 2024-09-11T01:58:32.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.618+0000 7f30ad7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.618+0000 7f30ad7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:32.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.789+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3090000b90 con 0x7f3094040000 2024-09-11T01:58:32.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.790+0000 7f30ad7fa640 1 -- 172.21.15.73:0/1982829811 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34198 (unknown 2965378022 0 3637933121) 0x7f3090000b90 con 0x7f3094040000 2024-09-11T01:58:32.793 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:32.793 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-11T01:58:32.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.792+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 >> v1:172.21.15.203:6812/2311533528 conn(0x7f3094040000 legacy=0x7f30940424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.792+0000 7f30b7047640 10 monclient: shutdown 2024-09-11T01:58:32.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.792+0000 7f30b7047640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:32.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.792+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 >> v1:172.21.15.73:6791/0 conn(0x7f30b00a72f0 legacy=0x7f30b009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.793+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 shutdown_connections 2024-09-11T01:58:32.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.793+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 >> 172.21.15.73:0/1982829811 conn(0x7f30b00a8050 msgr2=0x7f30b00a9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:32.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.793+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 shutdown_connections 2024-09-11T01:58:32.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.793+0000 7f30b7047640 1 -- 172.21.15.73:0/1982829811 wait complete. 2024-09-11T01:58:32.805 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-11T01:58:32.574066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163328,"kb_used_data":1120,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067712,"statfs":{"total":579820584960,"available":579653337088,"internally_reserved":0,"allocated":1146880,"data_stored":1386100,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.694156"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988312+0000","last_change":"2024-09-11T01:58:28.988312+0000","last_active":"2024-09-11T01:58:28.988312+0000","last_peered":"2024-09-11T01:58:28.988312+0000","last_clean":"2024-09-11T01:58:28.988312+0000","last_became_active":"2024-09-11T01:58:27.047814+0000","last_became_peered":"2024-09-11T01:58:27.047814+0000","last_unstale":"2024-09-11T01:58:28.988312+0000","last_undegraded":"2024-09-11T01:58:28.988312+0000","last_fullsized":"2024-09-11T01:58:28.988312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:15.861207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040037900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.994316+0000","last_change":"2024-09-11T01:58:28.994589+0000","last_active":"2024-09-11T01:58:28.994316+0000","last_peered":"2024-09-11T01:58:28.994316+0000","last_clean":"2024-09-11T01:58:28.994316+0000","last_became_active":"2024-09-11T01:58:26.989307+0000","last_became_peered":"2024-09-11T01:58:26.989307+0000","last_unstale":"2024-09-11T01:58:28.994316+0000","last_undegraded":"2024-09-11T01:58:28.994316+0000","last_fullsized":"2024-09-11T01:58:28.994316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:05.162449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001059894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988266+0000","last_change":"2024-09-11T01:58:28.988266+0000","last_active":"2024-09-11T01:58:28.988266+0000","last_peered":"2024-09-11T01:58:28.988266+0000","last_clean":"2024-09-11T01:58:28.988266+0000","last_became_active":"2024-09-11T01:58:26.991911+0000","last_became_peered":"2024-09-11T01:58:26.991911+0000","last_unstale":"2024-09-11T01:58:28.988266+0000","last_undegraded":"2024-09-11T01:58:28.988266+0000","last_fullsized":"2024-09-11T01:58:28.988266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:11.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051120699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.994362+0000","last_change":"2024-09-11T01:58:28.994578+0000","last_active":"2024-09-11T01:58:28.994362+0000","last_peered":"2024-09-11T01:58:28.994362+0000","last_clean":"2024-09-11T01:58:28.994362+0000","last_became_active":"2024-09-11T01:58:26.989353+0000","last_became_peered":"2024-09-11T01:58:26.989353+0000","last_unstale":"2024-09-11T01:58:28.994362+0000","last_undegraded":"2024-09-11T01:58:28.994362+0000","last_fullsized":"2024-09-11T01:58:28.994362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:37.795438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010300419999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.997622+0000","last_change":"2024-09-11T01:58:28.992277+0000","last_active":"2024-09-11T01:58:28.997622+0000","last_peered":"2024-09-11T01:58:28.997622+0000","last_clean":"2024-09-11T01:58:28.997622+0000","last_became_active":"2024-09-11T01:58:26.992547+0000","last_became_peered":"2024-09-11T01:58:26.992547+0000","last_unstale":"2024-09-11T01:58:28.997622+0000","last_undegraded":"2024-09-11T01:58:28.997622+0000","last_fullsized":"2024-09-11T01:58:28.997622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:48.184504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707749999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988691+0000","last_change":"2024-09-11T01:58:28.988691+0000","last_active":"2024-09-11T01:58:28.988691+0000","last_peered":"2024-09-11T01:58:28.988691+0000","last_clean":"2024-09-11T01:58:28.988691+0000","last_became_active":"2024-09-11T01:58:26.989539+0000","last_became_peered":"2024-09-11T01:58:26.989539+0000","last_unstale":"2024-09-11T01:58:28.988691+0000","last_undegraded":"2024-09-11T01:58:28.988691+0000","last_fullsized":"2024-09-11T01:58:28.988691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:05.294029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063444800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988518+0000","last_change":"2024-09-11T01:58:28.988518+0000","last_active":"2024-09-11T01:58:28.988518+0000","last_peered":"2024-09-11T01:58:28.988518+0000","last_clean":"2024-09-11T01:58:28.988518+0000","last_became_active":"2024-09-11T01:58:26.992110+0000","last_became_peered":"2024-09-11T01:58:26.992110+0000","last_unstale":"2024-09-11T01:58:28.988518+0000","last_undegraded":"2024-09-11T01:58:28.988518+0000","last_fullsized":"2024-09-11T01:58:28.988518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:47.916474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058377799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.991608+0000","last_change":"2024-09-11T01:58:28.991608+0000","last_active":"2024-09-11T01:58:28.991608+0000","last_peered":"2024-09-11T01:58:28.991608+0000","last_clean":"2024-09-11T01:58:28.991608+0000","last_became_active":"2024-09-11T01:58:26.992862+0000","last_became_peered":"2024-09-11T01:58:26.992862+0000","last_unstale":"2024-09-11T01:58:28.991608+0000","last_undegraded":"2024-09-11T01:58:28.991608+0000","last_fullsized":"2024-09-11T01:58:28.991608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:02.837285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038950200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.987629+0000","last_change":"2024-09-11T01:58:22.348806+0000","last_active":"2024-09-11T01:58:28.987629+0000","last_peered":"2024-09-11T01:58:28.987629+0000","last_clean":"2024-09-11T01:58:28.987629+0000","last_became_active":"2024-09-11T01:58:22.347800+0000","last_became_peered":"2024-09-11T01:58:22.347800+0000","last_unstale":"2024-09-11T01:58:28.987629+0000","last_undegraded":"2024-09-11T01:58:28.987629+0000","last_fullsized":"2024-09-11T01:58:28.987629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_clean_scrub_stamp":"2024-09-11T01:58:20.928503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:37.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":176128,"data_stored":54720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":54701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":54701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":583629,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":583629,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":176128,"data_stored":54720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:58:32.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:58:32.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.900+0000 7f4582fec640 10 monclient: get_monmap_and_config 2024-09-11T01:58:32.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.900+0000 7f4582fec640 10 monclient: build_initial_monmap 2024-09-11T01:58:32.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.900+0000 7f4582fec640 10 monclient: monmap: 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:32.901811+0000 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:32.901811+0000 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:32.903 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:32.904 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:32.904 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:32.904 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.901+0000 7f4582fec640 1 Processor -- start 2024-09-11T01:58:32.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.901+0000 7f4582fec640 1 -- start start 2024-09-11T01:58:32.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.901+0000 7f4582fec640 10 monclient: init 2024-09-11T01:58:32.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:32.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 10 monclient: _add_conns ranks=[0,7,3,8,6,1,5,2,4] 2024-09-11T01:58:32.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 10 monclient(hunting): picked mon.noname-a con 0x7f457c138d40 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 10 monclient(hunting): picked mon.noname-i con 0x7f457c0a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 10 monclient(hunting): picked mon.noname-g con 0x7f457c13f350 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f457c09ca00 con 0x7f457c138d40 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f457c0a7070 con 0x7f457c13f350 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f457c09cee0 con 0x7f457c0a72f0 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 10 monclient(hunting): authenticate will time out at 754.506321s 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4580d88640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f457c138d40 0x7f457c139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50432/0 (socket says 172.21.15.73:50432) 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4580d88640 1 -- 172.21.15.73:0/3412765582 learned_addr learned my addr 172.21.15.73:0/3412765582 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 -- 172.21.15.73:0/3412765582 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345306601 0 0) 0x7f457c09ca00 con 0x7f457c138d40 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient(hunting): my global_id is 4401 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 -- 172.21.15.73:0/3412765582 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4564003520 con 0x7f457c138d40 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 -- 172.21.15.73:0/3412765582 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1644544526 0 0) 0x7f4564003520 con 0x7f457c138d40 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 -- 172.21.15.73:0/3412765582 >> v1:172.21.15.203:6792/0 conn(0x7f457c0a72f0 legacy=0x7f457c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 -- 172.21.15.73:0/3412765582 >> v1:172.21.15.203:6790/0 conn(0x7f457c13f350 legacy=0x7f457c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 monclient: found mon.noname-a 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 -- 172.21.15.73:0/3412765582 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457c09d1c0 con 0x7f457c138d40 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:32.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 5 monclient: authenticate success, global_id 4401 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 -- 172.21.15.73:0/3412765582 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f456c001850 con 0x7f457c138d40 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient: dump: 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.915 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:32.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 -- 172.21.15.73:0/3412765582 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f456c001a70 con 0x7f457c138d40 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 1 -- 172.21.15.73:0/3412765582 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f456c004be0 con 0x7f457c138d40 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f4582fec640 4 set_mon_vals no callback set 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.902+0000 7f457b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f457b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f457b7fe640 10 monclient: dump: 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.917 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f4582fec640 10 monclient: shutdown 2024-09-11T01:58:32.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f4582fec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f4582fec640 1 -- 172.21.15.73:0/3412765582 >> v1:172.21.15.73:6789/0 conn(0x7f457c138d40 legacy=0x7f457c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f4582fec640 1 -- 172.21.15.73:0/3412765582 shutdown_connections 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f4582fec640 1 -- 172.21.15.73:0/3412765582 >> 172.21.15.73:0/3412765582 conn(0x7f457c0a8050 msgr2=0x7f457c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f4582fec640 1 -- 172.21.15.73:0/3412765582 shutdown_connections 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f4582fec640 1 -- 172.21.15.73:0/3412765582 wait complete. 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.903+0000 7f4582fec640 10 monclient: build_initial_monmap 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 10 monclient: monmap: 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:32.919 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 1 Processor -- start 2024-09-11T01:58:32.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 1 -- start start 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 10 monclient: init 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 10 monclient: _add_conns ranks=[8,7,6,0,5,3,1,2,4] 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 10 monclient(hunting): picked mon.noname-e con 0x7f457c0a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 10 monclient(hunting): picked mon.noname-i con 0x7f457c138d40 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 10 monclient(hunting): picked mon.noname-d con 0x7f457c13f350 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f457c140550 con 0x7f457c13f350 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.904+0000 7f4582fec640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f457c142910 con 0x7f457c138d40 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f457c0a5350 con 0x7f457c0a72f0 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:32.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 10 monclient(hunting): authenticate will time out at 754.509022s 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4580d88640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f457c0a72f0 0x7f457c13f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:37178/0 (socket says 172.21.15.73:37178) 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4580d88640 1 -- 172.21.15.73:0/157936549 learned_addr learned my addr 172.21.15.73:0/157936549 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4581589640 1 --1- 172.21.15.73:0/157936549 >> v1:172.21.15.73:6792/0 conn(0x7f457c13f350 0x7f457c1d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:35110/0 (socket says 172.21.15.73:35110) 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962038770 0 0) 0x7f457c0a5350 con 0x7f457c0a72f0 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): my global_id is 4319 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4568003520 con 0x7f457c0a72f0 2024-09-11T01:58:32.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660813309 0 0) 0x7f457c140550 con 0x7f457c13f350 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): my global_id is 4335 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f457c0a5350 con 0x7f457c13f350 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690706523 0 0) 0x7f457c142910 con 0x7f457c138d40 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): my global_id is 4327 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f457c140550 con 0x7f457c138d40 2024-09-11T01:58:32.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2435540326 0 0) 0x7f457c0a5350 con 0x7f457c13f350 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f457c142910 con 0x7f457c13f350 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4574001d30 con 0x7f457c13f350 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): dump: 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.924 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.925 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2368328840 0 0) 0x7f4568003520 con 0x7f457c0a72f0 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f457c0a5350 con 0x7f457c0a72f0 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f456c004b20 con 0x7f457c0a72f0 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): dump: 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.926 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.927 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1950319528 0 0) 0x7f457c140550 con 0x7f457c138d40 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4568003520 con 0x7f457c138d40 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4570001a50 con 0x7f457c138d40 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient(hunting): dump: 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.928 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1041416551 0 0) 0x7f457c142910 con 0x7f457c13f350 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 >> v1:172.21.15.73:6793/0 conn(0x7f457c0a72f0 legacy=0x7f457c13f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 >> v1:172.21.15.203:6792/0 conn(0x7f457c138d40 legacy=0x7f457c13fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 monclient: found mon.d 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f457c1420f0 con 0x7f457c13f350 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 5 monclient: authenticate success, global_id 4335 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 10 monclient: _renew_subs 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f457c0a0ea0 con 0x7f457c13f350 2024-09-11T01:58:32.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 10 monclient: _renew_subs 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f457c1d74c0 con 0x7f457c13f350 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4574001fd0 con 0x7f457c13f350 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4574003f80 con 0x7f457c13f350 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f457affd640 4 set_mon_vals no callback set 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.905+0000 7f45797fa640 10 monclient: dump: 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:32.931 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.906+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f4574004120 con 0x7f457c13f350 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.906+0000 7f4582fec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.906+0000 7f4582fec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.906+0000 7f4582fec640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.906+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455c005080 con 0x7f457c13f350 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.906+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7f457404e450 con 0x7f457c13f350 2024-09-11T01:58:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.907+0000 7f4580d88640 10 monclient: get_auth_request con 0x7f45680406f0 auth_method 0 2024-09-11T01:58:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.911+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f45740176c0 con 0x7f457c13f350 2024-09-11T01:58:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.911+0000 7f45797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:32.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:32.911+0000 7f45797fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:33.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.090+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f455c000b90 con 0x7f45680406f0 2024-09-11T01:58:33.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.091+0000 7f45797fa640 1 -- 172.21.15.73:0/157936549 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34198 (unknown 2965378022 0 1697346903) 0x7f455c000b90 con 0x7f45680406f0 2024-09-11T01:58:33.093 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-11T01:58:33.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.093+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 >> v1:172.21.15.203:6812/2311533528 conn(0x7f45680406f0 legacy=0x7f4568042bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.093+0000 7f4582fec640 10 monclient: shutdown 2024-09-11T01:58:33.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.093+0000 7f4582fec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:33.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.093+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 >> v1:172.21.15.73:6792/0 conn(0x7f457c13f350 legacy=0x7f457c1d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.093+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 shutdown_connections 2024-09-11T01:58:33.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.093+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 >> 172.21.15.73:0/157936549 conn(0x7f457c0a8050 msgr2=0x7f457c0a9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:33.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.093+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 shutdown_connections 2024-09-11T01:58:33.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.093+0000 7f4582fec640 1 -- 172.21.15.73:0/157936549 wait complete. 2024-09-11T01:58:33.105 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-11T01:58:32.881222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163328,"kb_used_data":1120,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067712,"statfs":{"total":579820584960,"available":579653337088,"internally_reserved":0,"allocated":1146880,"data_stored":1386100,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.896307"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988312+0000","last_change":"2024-09-11T01:58:28.988312+0000","last_active":"2024-09-11T01:58:28.988312+0000","last_peered":"2024-09-11T01:58:28.988312+0000","last_clean":"2024-09-11T01:58:28.988312+0000","last_became_active":"2024-09-11T01:58:27.047814+0000","last_became_peered":"2024-09-11T01:58:27.047814+0000","last_unstale":"2024-09-11T01:58:28.988312+0000","last_undegraded":"2024-09-11T01:58:28.988312+0000","last_fullsized":"2024-09-11T01:58:28.988312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:15.861207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040037900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.994316+0000","last_change":"2024-09-11T01:58:28.994589+0000","last_active":"2024-09-11T01:58:28.994316+0000","last_peered":"2024-09-11T01:58:28.994316+0000","last_clean":"2024-09-11T01:58:28.994316+0000","last_became_active":"2024-09-11T01:58:26.989307+0000","last_became_peered":"2024-09-11T01:58:26.989307+0000","last_unstale":"2024-09-11T01:58:28.994316+0000","last_undegraded":"2024-09-11T01:58:28.994316+0000","last_fullsized":"2024-09-11T01:58:28.994316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:05.162449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001059894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988266+0000","last_change":"2024-09-11T01:58:28.988266+0000","last_active":"2024-09-11T01:58:28.988266+0000","last_peered":"2024-09-11T01:58:28.988266+0000","last_clean":"2024-09-11T01:58:28.988266+0000","last_became_active":"2024-09-11T01:58:26.991911+0000","last_became_peered":"2024-09-11T01:58:26.991911+0000","last_unstale":"2024-09-11T01:58:28.988266+0000","last_undegraded":"2024-09-11T01:58:28.988266+0000","last_fullsized":"2024-09-11T01:58:28.988266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:11.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051120699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.994362+0000","last_change":"2024-09-11T01:58:28.994578+0000","last_active":"2024-09-11T01:58:28.994362+0000","last_peered":"2024-09-11T01:58:28.994362+0000","last_clean":"2024-09-11T01:58:28.994362+0000","last_became_active":"2024-09-11T01:58:26.989353+0000","last_became_peered":"2024-09-11T01:58:26.989353+0000","last_unstale":"2024-09-11T01:58:28.994362+0000","last_undegraded":"2024-09-11T01:58:28.994362+0000","last_fullsized":"2024-09-11T01:58:28.994362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:37.795438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010300419999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.997622+0000","last_change":"2024-09-11T01:58:28.992277+0000","last_active":"2024-09-11T01:58:28.997622+0000","last_peered":"2024-09-11T01:58:28.997622+0000","last_clean":"2024-09-11T01:58:28.997622+0000","last_became_active":"2024-09-11T01:58:26.992547+0000","last_became_peered":"2024-09-11T01:58:26.992547+0000","last_unstale":"2024-09-11T01:58:28.997622+0000","last_undegraded":"2024-09-11T01:58:28.997622+0000","last_fullsized":"2024-09-11T01:58:28.997622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:48.184504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707749999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988691+0000","last_change":"2024-09-11T01:58:28.988691+0000","last_active":"2024-09-11T01:58:28.988691+0000","last_peered":"2024-09-11T01:58:28.988691+0000","last_clean":"2024-09-11T01:58:28.988691+0000","last_became_active":"2024-09-11T01:58:26.989539+0000","last_became_peered":"2024-09-11T01:58:26.989539+0000","last_unstale":"2024-09-11T01:58:28.988691+0000","last_undegraded":"2024-09-11T01:58:28.988691+0000","last_fullsized":"2024-09-11T01:58:28.988691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:05.294029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063444800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988518+0000","last_change":"2024-09-11T01:58:28.988518+0000","last_active":"2024-09-11T01:58:28.988518+0000","last_peered":"2024-09-11T01:58:28.988518+0000","last_clean":"2024-09-11T01:58:28.988518+0000","last_became_active":"2024-09-11T01:58:26.992110+0000","last_became_peered":"2024-09-11T01:58:26.992110+0000","last_unstale":"2024-09-11T01:58:28.988518+0000","last_undegraded":"2024-09-11T01:58:28.988518+0000","last_fullsized":"2024-09-11T01:58:28.988518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:47.916474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058377799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.991608+0000","last_change":"2024-09-11T01:58:28.991608+0000","last_active":"2024-09-11T01:58:28.991608+0000","last_peered":"2024-09-11T01:58:28.991608+0000","last_clean":"2024-09-11T01:58:28.991608+0000","last_became_active":"2024-09-11T01:58:26.992862+0000","last_became_peered":"2024-09-11T01:58:26.992862+0000","last_unstale":"2024-09-11T01:58:28.991608+0000","last_undegraded":"2024-09-11T01:58:28.991608+0000","last_fullsized":"2024-09-11T01:58:28.991608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:02.837285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038950200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.987629+0000","last_change":"2024-09-11T01:58:22.348806+0000","last_active":"2024-09-11T01:58:28.987629+0000","last_peered":"2024-09-11T01:58:28.987629+0000","last_clean":"2024-09-11T01:58:28.987629+0000","last_became_active":"2024-09-11T01:58:22.347800+0000","last_became_peered":"2024-09-11T01:58:22.347800+0000","last_unstale":"2024-09-11T01:58:28.987629+0000","last_undegraded":"2024-09-11T01:58:28.987629+0000","last_fullsized":"2024-09-11T01:58:28.987629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_clean_scrub_stamp":"2024-09-11T01:58:20.928503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:37.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":176128,"data_stored":54720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":54701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":54701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":583629,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":583629,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":176128,"data_stored":54720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:58:33.106 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T01:58:33.106 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T01:58:33.106 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T01:58:33.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T01:58:33.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.200+0000 7fe340c52640 10 monclient: get_monmap_and_config 2024-09-11T01:58:33.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.200+0000 7fe340c52640 10 monclient: build_initial_monmap 2024-09-11T01:58:33.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.200+0000 7fe340c52640 10 monclient: monmap: 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:33.201781+0000 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:33.201781+0000 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:33.203 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:33.204 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:33.204 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.201+0000 7fe340c52640 1 Processor -- start 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.201+0000 7fe340c52640 1 -- start start 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.201+0000 7fe340c52640 10 monclient: init 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 10 monclient: _add_conns ranks=[7,1,3,8,4,0,5,2,6] 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 10 monclient(hunting): picked mon.noname-i con 0x7fe33c138d40 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 10 monclient(hunting): picked mon.noname-f con 0x7fe33c0a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 10 monclient(hunting): picked mon.noname-g con 0x7fe33c13f350 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33c09ca00 con 0x7fe33c0a72f0 2024-09-11T01:58:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33c0a7070 con 0x7fe33c13f350 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33c09cee0 con 0x7fe33c138d40 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe340c52640 10 monclient(hunting): authenticate will time out at 754.806342s 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe339d9b640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fe33c0a72f0 0x7fe33c13dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.73:54690/0 (socket says 172.21.15.73:54690) 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe339d9b640 1 -- 172.21.15.73:0/3328793012 learned_addr learned my addr 172.21.15.73:0/3328793012 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.202+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556340489 0 0) 0x7fe33c09ca00 con 0x7fe33c0a72f0 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): my global_id is 4348 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe324003520 con 0x7fe33c0a72f0 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797639017 0 0) 0x7fe33c09cee0 con 0x7fe33c138d40 2024-09-11T01:58:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): my global_id is 4336 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe33c09ca00 con 0x7fe33c138d40 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566216962 0 0) 0x7fe33c0a7070 con 0x7fe33c13f350 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient(hunting): my global_id is 4404 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe33c09cee0 con 0x7fe33c13f350 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1909278110 0 0) 0x7fe324003520 con 0x7fe33c0a72f0 2024-09-11T01:58:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 >> v1:172.21.15.203:6792/0 conn(0x7fe33c138d40 legacy=0x7fe33c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 >> v1:172.21.15.203:6790/0 conn(0x7fe33c13f350 legacy=0x7fe33c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: _finish_hunting 0 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 monclient: found mon.noname-f 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.203:6789/0 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c09d1c0 con 0x7fe33c0a72f0 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: _finish_auth 0 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: _check_auth_tickets 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe330001850 con 0x7fe33c0a72f0 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe340c52640 5 monclient: authenticate success, global_id 4348 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe340c52640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:33.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: dump: 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe340c52640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 <== mon.1 v1:172.21.15.203:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe330001a70 con 0x7fe33c0a72f0 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 1 -- 172.21.15.73:0/3328793012 <== mon.1 v1:172.21.15.203:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe330004be0 con 0x7fe33c0a72f0 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe340c52640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe340c52640 4 set_mon_vals no callback set 2024-09-11T01:58:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe33959a640 10 monclient: dump: 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.220 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.220 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.220 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.220 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.220 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe340c52640 10 monclient: shutdown 2024-09-11T01:58:33.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe340c52640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.203+0000 7fe340c52640 1 -- 172.21.15.73:0/3328793012 >> v1:172.21.15.203:6789/0 conn(0x7fe33c0a72f0 legacy=0x7fe33c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.204+0000 7fe340c52640 1 -- 172.21.15.73:0/3328793012 shutdown_connections 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.204+0000 7fe340c52640 1 -- 172.21.15.73:0/3328793012 >> 172.21.15.73:0/3328793012 conn(0x7fe33c0a8050 msgr2=0x7fe33c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.204+0000 7fe340c52640 1 -- 172.21.15.73:0/3328793012 shutdown_connections 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.204+0000 7fe340c52640 1 -- 172.21.15.73:0/3328793012 wait complete. 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.204+0000 7fe340c52640 10 monclient: build_initial_monmap 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.204+0000 7fe340c52640 10 monclient: monmap: 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 1 Processor -- start 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 1 -- start start 2024-09-11T01:58:33.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 10 monclient: init 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 10 monclient: _add_conns ranks=[3,0,6,7,5,2,4,1,8] 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 10 monclient(hunting): picked mon.noname-g con 0x7fe33c0a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 10 monclient(hunting): picked mon.noname-a con 0x7fe33c138d40 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 10 monclient(hunting): picked mon.noname-d con 0x7fe33c13f350 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33c13c540 con 0x7fe33c138d40 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33c13b000 con 0x7fe33c0a72f0 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33c0a4ec0 con 0x7fe33c13f350 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe340c52640 10 monclient(hunting): authenticate will time out at 754.809636s 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe339d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe33c138d40 0x7fe33c1d2280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50438/0 (socket says 172.21.15.73:50438) 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe339d9b640 1 -- 172.21.15.73:0/3982807778 learned_addr learned my addr 172.21.15.73:0/3982807778 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:33.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe33ad9d640 1 --1- 172.21.15.73:0/3982807778 >> v1:172.21.15.73:6792/0 conn(0x7fe33c13f350 0x7fe33c1d59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:35112/0 (socket says 172.21.15.73:35112) 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796132846 0 0) 0x7fe33c13c540 con 0x7fe33c138d40 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 10 monclient(hunting): my global_id is 4410 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe31c003520 con 0x7fe33c138d40 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953111247 0 0) 0x7fe33c0a4ec0 con 0x7fe33c13f350 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.205+0000 7fe32affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): my global_id is 4344 2024-09-11T01:58:33.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe33c13c540 con 0x7fe33c13f350 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034991516 0 0) 0x7fe33c13b000 con 0x7fe33c0a72f0 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): my global_id is 4413 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe33c0a4ec0 con 0x7fe33c0a72f0 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3729963801 0 0) 0x7fe33c13c540 con 0x7fe33c13f350 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe33c13b000 con 0x7fe33c13f350 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe334001840 con 0x7fe33c13f350 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): dump: 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.225 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.226 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2486250239 0 0) 0x7fe31c003520 con 0x7fe33c138d40 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe33c13c540 con 0x7fe33c138d40 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3396407928 0 0) 0x7fe33c0a4ec0 con 0x7fe33c0a72f0 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe31c003520 con 0x7fe33c0a72f0 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe330004b20 con 0x7fe33c138d40 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): dump: 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.227 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.228 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe32c0018d0 con 0x7fe33c0a72f0 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient(hunting): dump: 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.229 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3556901641 0 0) 0x7fe33c13b000 con 0x7fe33c13f350 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 >> v1:172.21.15.203:6790/0 conn(0x7fe33c0a72f0 legacy=0x7fe33c13dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 >> v1:172.21.15.73:6789/0 conn(0x7fe33c138d40 legacy=0x7fe33c1d2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 monclient: found mon.d 2024-09-11T01:58:33.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c0a16f0 con 0x7fe33c13f350 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient: _finish_auth 0 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe340c52640 5 monclient: authenticate success, global_id 4344 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe340c52640 10 monclient: _renew_subs 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe340c52640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c13bfc0 con 0x7fe33c13f350 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe340c52640 10 monclient: _renew_subs 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe340c52640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fe33c1cd3e0 con 0x7fe33c13f350 2024-09-11T01:58:33.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3340047a0 con 0x7fe33c13f350 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe334004c90 con 0x7fe33c13f350 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe338d99640 4 set_mon_vals no callback set 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.206+0000 7fe32affd640 10 monclient: dump: 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.232 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.207+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fe3340113d0 con 0x7fe33c13f350 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.207+0000 7fe340c52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.207+0000 7fe340c52640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.207+0000 7fe340c52640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.207+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe320005080 con 0x7fe33c13f350 2024-09-11T01:58:33.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.207+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7fe33404e140 con 0x7fe33c13f350 2024-09-11T01:58:33.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.208+0000 7fe33a59c640 10 monclient: get_auth_request con 0x7fe31c0406b0 auth_method 0 2024-09-11T01:58:33.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.212+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fe33c13bfc0 con 0x7fe33c13f350 2024-09-11T01:58:33.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.212+0000 7fe32affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:33.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.212+0000 7fe32affd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:33.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.422+0000 7fe340c52640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-09-11T01:58:33.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.422+0000 7fe340c52640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-09-11T01:58:33.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.422+0000 7fe340c52640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:33.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.422+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe320005370 con 0x7fe33c13f350 2024-09-11T01:58:33.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.422+0000 7fe32affd640 1 -- 172.21.15.73:0/3982807778 <== mon.6 v1:172.21.15.73:6792/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7fe334017470 con 0x7fe33c13f350 2024-09-11T01:58:33.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.422+0000 7fe32affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-09-11T01:58:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.422+0000 7fe32affd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:33.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:33.425 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T01:58:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.424+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 >> v1:172.21.15.203:6812/2311533528 conn(0x7fe31c0406b0 legacy=0x7fe31c042b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.424+0000 7fe340c52640 10 monclient: shutdown 2024-09-11T01:58:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.424+0000 7fe340c52640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.424+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 >> v1:172.21.15.73:6792/0 conn(0x7fe33c13f350 legacy=0x7fe33c1d59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.424+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 shutdown_connections 2024-09-11T01:58:33.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.424+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 >> 172.21.15.73:0/3982807778 conn(0x7fe33c0a8050 msgr2=0x7fe33c0a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:33.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.425+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 shutdown_connections 2024-09-11T01:58:33.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.425+0000 7fe340c52640 1 -- 172.21.15.73:0/3982807778 wait complete. 2024-09-11T01:58:33.437 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T01:58:33.437 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-11T01:58:33.483 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-11T01:58:33.483 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T01:58:33.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.580+0000 7f261d973640 10 monclient: get_monmap_and_config 2024-09-11T01:58:33.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.580+0000 7f261d973640 10 monclient: build_initial_monmap 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.580+0000 7f261d973640 10 monclient: monmap: 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:33.581016+0000 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:33.581016+0000 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:33.582 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:33.583 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:33.583 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:33.583 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:33.583 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:33.583 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.580+0000 7f261d973640 1 Processor -- start 2024-09-11T01:58:33.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.580+0000 7f261d973640 1 -- start start 2024-09-11T01:58:33.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.580+0000 7f261d973640 10 monclient: init 2024-09-11T01:58:33.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:33.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 10 monclient: _add_conns ranks=[3,0,5,7,2,4,1,6,8] 2024-09-11T01:58:33.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 10 monclient(hunting): picked mon.noname-g con 0x7f2618138960 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:33.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 10 monclient(hunting): picked mon.noname-a con 0x7f2618139450 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:33.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 10 monclient(hunting): picked mon.noname-h con 0x7f261813f620 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:33.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f261809d030 con 0x7f2618139450 2024-09-11T01:58:33.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f261809d310 con 0x7f2618138960 2024-09-11T01:58:33.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f261806f770 con 0x7f261813f620 2024-09-11T01:58:33.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:33.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 10 monclient(hunting): authenticate will time out at 755.185354s 2024-09-11T01:58:33.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f26167fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2618139450 0x7f261813df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50446/0 (socket says 172.21.15.73:50446) 2024-09-11T01:58:33.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f26167fc640 1 -- 172.21.15.73:0/2316817169 learned_addr learned my addr 172.21.15.73:0/2316817169 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:33.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 1 -- 172.21.15.73:0/2316817169 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476711656 0 0) 0x7f261809d030 con 0x7f2618139450 2024-09-11T01:58:33.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient(hunting): my global_id is 4419 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 1 -- 172.21.15.73:0/2316817169 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2604003520 con 0x7f2618139450 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 1 -- 172.21.15.73:0/2316817169 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1246644578 0 0) 0x7f2604003520 con 0x7f2618139450 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 1 -- 172.21.15.73:0/2316817169 >> v1:172.21.15.203:6791/0 conn(0x7f261813f620 legacy=0x7f2618141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 1 -- 172.21.15.73:0/2316817169 >> v1:172.21.15.203:6790/0 conn(0x7f2618138960 legacy=0x7f2618138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient: _finish_hunting 0 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 1 monclient: found mon.noname-a 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:33.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 1 -- 172.21.15.73:0/2316817169 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26180a7360 con 0x7f2618139450 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient: _finish_auth 0 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient: _check_auth_tickets 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 5 monclient: authenticate success, global_id 4419 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 1 -- 172.21.15.73:0/2316817169 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2600001830 con 0x7f2618139450 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f2615ffb640 10 monclient: dump: 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.595 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.596 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.581+0000 7f261d973640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f2615ffb640 1 -- 172.21.15.73:0/2316817169 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2600001a50 con 0x7f2618139450 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f2615ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f261d973640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f2615ffb640 1 -- 172.21.15.73:0/2316817169 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2600004be0 con 0x7f2618139450 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f2615ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f261d973640 4 set_mon_vals no callback set 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f2615ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:33.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f2615ffb640 10 monclient: dump: 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.598 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f261d973640 10 monclient: shutdown 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f261d973640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f261d973640 1 -- 172.21.15.73:0/2316817169 >> v1:172.21.15.73:6789/0 conn(0x7f2618139450 legacy=0x7f261813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f261d973640 1 -- 172.21.15.73:0/2316817169 shutdown_connections 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f261d973640 1 -- 172.21.15.73:0/2316817169 >> 172.21.15.73:0/2316817169 conn(0x7f26180a8050 msgr2=0x7f26180a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f261d973640 1 -- 172.21.15.73:0/2316817169 shutdown_connections 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.582+0000 7f261d973640 1 -- 172.21.15.73:0/2316817169 wait complete. 2024-09-11T01:58:33.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.583+0000 7f261d973640 10 monclient: build_initial_monmap 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.583+0000 7f261d973640 10 monclient: monmap: 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:33.600 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.583+0000 7f261d973640 1 Processor -- start 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.583+0000 7f261d973640 1 -- start start 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.583+0000 7f261d973640 10 monclient: init 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.583+0000 7f261d973640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.583+0000 7f261d973640 10 monclient: _add_conns ranks=[5,0,7,6,1,3,2,4,8] 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.583+0000 7f261d973640 10 monclient(hunting): picked mon.noname-h con 0x7f2618138960 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:33.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 10 monclient(hunting): picked mon.noname-a con 0x7f2618139450 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 10 monclient(hunting): picked mon.noname-i con 0x7f261813f620 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2618142a30 con 0x7f2618139450 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f261813cd30 con 0x7f2618138960 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f261813aaf0 con 0x7f261813f620 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 10 monclient(hunting): authenticate will time out at 755.188099s 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f26167fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2618139450 0x7f261813a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50462/0 (socket says 172.21.15.73:50462) 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f26167fc640 1 -- 172.21.15.73:0/4065565641 learned_addr learned my addr 172.21.15.73:0/4065565641 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250700747 0 0) 0x7f26180a7360 con 0x7f2618139450 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): my global_id is 4428 2024-09-11T01:58:33.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25f8003520 con 0x7f2618139450 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443027963 0 0) 0x7f261813cd30 con 0x7f2618138960 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): my global_id is 4397 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26180a7360 con 0x7f2618138960 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288804763 0 0) 0x7f261813aaf0 con 0x7f261813f620 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): my global_id is 4345 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f261813cd30 con 0x7f261813f620 2024-09-11T01:58:33.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4172009451 0 0) 0x7f25f8003520 con 0x7f2618139450 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f261813aaf0 con 0x7f2618139450 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2600004b20 con 0x7f2618139450 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): dump: 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.604 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1846015166 0 0) 0x7f261813aaf0 con 0x7f2618139450 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 >> v1:172.21.15.203:6792/0 conn(0x7f261813f620 legacy=0x7f26181d5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 >> v1:172.21.15.203:6791/0 conn(0x7f2618138960 legacy=0x7f2618139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 monclient: found mon.a 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2618142ea0 con 0x7f2618139450 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient: _finish_auth 0 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 5 monclient: authenticate success, global_id 4428 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 10 monclient: _renew_subs 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f261813efc0 con 0x7f2618139450 2024-09-11T01:58:33.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 10 monclient: _renew_subs 2024-09-11T01:58:33.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:33.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f261813c770 con 0x7f2618139450 2024-09-11T01:58:33.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2600004ea0 con 0x7f2618139450 2024-09-11T01:58:33.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:33.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2600005390 con 0x7f2618139450 2024-09-11T01:58:33.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:33.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:33.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f26157fa640 4 set_mon_vals no callback set 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.584+0000 7f260ffff640 10 monclient: dump: 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.609 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.585+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f2600011ad0 con 0x7f2618139450 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.585+0000 7f261d973640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.585+0000 7f261d973640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.585+0000 7f261d973640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.585+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc005080 con 0x7f2618139450 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.585+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7f260004e390 con 0x7f2618139450 2024-09-11T01:58:33.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.586+0000 7f2616ffd640 10 monclient: get_auth_request con 0x7f25f803fcf0 auth_method 0 2024-09-11T01:58:33.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.590+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f2618142a30 con 0x7f2618139450 2024-09-11T01:58:33.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.590+0000 7f260ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:33.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.590+0000 7f260ffff640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:33.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.768+0000 7f261d973640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:33.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.768+0000 7f261d973640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:33.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.768+0000 7f261d973640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:33.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.768+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25fc005370 con 0x7f2618139450 2024-09-11T01:58:33.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.768+0000 7f260ffff640 1 -- 172.21.15.73:0/4065565641 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+10910 (unknown 898900276 0 2607695171) 0x7f2600017720 con 0x7f2618139450 2024-09-11T01:58:33.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.768+0000 7f260ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T01:58:33.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.768+0000 7f260ffff640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:33.771 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:33.771 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","created":"2024-09-11T01:58:08.604820+0000","modified":"2024-09-11T01:58:32.569626+0000","last_up_change":"2024-09-11T01:58:19.924468+0000","last_in_change":"2024-09-11T01:58:10.229533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:58:20.893945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T01:58:25.343535+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ed1d0ce-ed57-4eed-b684-5c04e84a8405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":3691603832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":3691603832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":3691603832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":3691603832}]},"public_addr":"172.21.15.73:6804/3691603832","cluster_addr":"172.21.15.73:6805/3691603832","heartbeat_back_addr":"172.21.15.73:6807/3691603832","heartbeat_front_addr":"172.21.15.73:6806/3691603832","state":["exists","up"]},{"osd":1,"uuid":"3aa077b3-74c6-4609-8587-8a3c5ec8bc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":2131770571}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":2131770571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":2131770571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":2131770571}]},"public_addr":"172.21.15.73:6800/2131770571","cluster_addr":"172.21.15.73:6801/2131770571","heartbeat_back_addr":"172.21.15.73:6803/2131770571","heartbeat_front_addr":"172.21.15.73:6802/2131770571","state":["exists","up"]},{"osd":2,"uuid":"063c664b-ce58-42bd-bd80-0d6b9721fcb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":2154209098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":2154209098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":2154209098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":2154209098}]},"public_addr":"172.21.15.73:6808/2154209098","cluster_addr":"172.21.15.73:6809/2154209098","heartbeat_back_addr":"172.21.15.73:6811/2154209098","heartbeat_front_addr":"172.21.15.73:6810/2154209098","state":["exists","up"]},{"osd":3,"uuid":"12d01ea7-7a0e-4b5a-ac25-a6ba6af66458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6808","nonce":1861196202}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6809","nonce":1861196202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6811","nonce":1861196202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6810","nonce":1861196202}]},"public_addr":"172.21.15.203:6808/1861196202","cluster_addr":"172.21.15.203:6809/1861196202","heartbeat_back_addr":"172.21.15.203:6811/1861196202","heartbeat_front_addr":"172.21.15.203:6810/1861196202","state":["exists","up"]},{"osd":4,"uuid":"8b89af16-5602-4527-ba2c-b7142acac9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6804","nonce":1562443458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6805","nonce":1562443458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6807","nonce":1562443458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6806","nonce":1562443458}]},"public_addr":"172.21.15.203:6804/1562443458","cluster_addr":"172.21.15.203:6805/1562443458","heartbeat_back_addr":"172.21.15.203:6807/1562443458","heartbeat_front_addr":"172.21.15.203:6806/1562443458","state":["exists","up"]},{"osd":5,"uuid":"ae991c5c-eac0-4bd2-8d87-7efa36a62abb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6800","nonce":464336651}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6801","nonce":464336651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6803","nonce":464336651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6802","nonce":464336651}]},"public_addr":"172.21.15.203:6800/464336651","cluster_addr":"172.21.15.203:6801/464336651","heartbeat_back_addr":"172.21.15.203:6803/464336651","heartbeat_front_addr":"172.21.15.203:6802/464336651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.395799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.286329+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.691165+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.965210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.767253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.540222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:58:33.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.770+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 >> v1:172.21.15.203:6812/2311533528 conn(0x7f25f803fcf0 legacy=0x7f25f80421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.770+0000 7f261d973640 10 monclient: shutdown 2024-09-11T01:58:33.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.770+0000 7f261d973640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:33.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.770+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 >> v1:172.21.15.73:6789/0 conn(0x7f2618139450 legacy=0x7f261813a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.770+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 shutdown_connections 2024-09-11T01:58:33.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.770+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 >> 172.21.15.73:0/4065565641 conn(0x7f26180a8050 msgr2=0x7f2618141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:33.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.771+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 shutdown_connections 2024-09-11T01:58:33.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.771+0000 7f261d973640 1 -- 172.21.15.73:0/4065565641 wait complete. 2024-09-11T01:58:33.783 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T01:58:20.893945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T01:58:25.343535+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T01:58:33.783 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T01:58:33.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.881+0000 7f95466bd640 10 monclient: get_monmap_and_config 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.881+0000 7f95466bd640 10 monclient: build_initial_monmap 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.881+0000 7f95466bd640 10 monclient: monmap: 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:33.882181+0000 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:33.882181+0000 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:33.883 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:33.884 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:33.884 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:33.884 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:33.884 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:33.884 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:33.884 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:33.884 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 1 Processor -- start 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 1 -- start start 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 10 monclient: init 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 10 monclient: _add_conns ranks=[4,7,2,3,8,1,6,5,0] 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 10 monclient(hunting): picked mon.noname-c con 0x7f9540138d40 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 10 monclient(hunting): picked mon.noname-i con 0x7f95400a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 10 monclient(hunting): picked mon.noname-b con 0x7f954013f350 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954009ca00 con 0x7f954013f350 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95400a7070 con 0x7f9540138d40 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954009cee0 con 0x7f95400a72f0 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f95466bd640 10 monclient(hunting): authenticate will time out at 755.486664s 2024-09-11T01:58:33.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f9544c5a640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f954013f350 0x7f9540141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53618/0 (socket says 172.21.15.73:53618) 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f9544c5a640 1 -- 172.21.15.73:0/2100478362 learned_addr learned my addr 172.21.15.73:0/2100478362 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f953ffff640 1 --1- 172.21.15.73:0/2100478362 >> v1:172.21.15.73:6791/0 conn(0x7f9540138d40 0x7f9540139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49266/0 (socket says 172.21.15.73:49266) 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.882+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244052855 0 0) 0x7f954009ca00 con 0x7f954013f350 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient(hunting): my global_id is 4367 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9528003520 con 0x7f954013f350 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3742300766 0 0) 0x7f95400a7070 con 0x7f9540138d40 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient(hunting): my global_id is 4396 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f954009ca00 con 0x7f9540138d40 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1582561000 0 0) 0x7f9528003520 con 0x7f954013f350 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 >> v1:172.21.15.203:6792/0 conn(0x7f95400a72f0 legacy=0x7f954013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 >> v1:172.21.15.73:6791/0 conn(0x7f9540138d40 legacy=0x7f9540139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 monclient: found mon.noname-b 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954009d1c0 con 0x7f954013f350 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: _finish_auth 0 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9538001bd0 con 0x7f954013f350 2024-09-11T01:58:33.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 5 monclient: authenticate success, global_id 4367 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: dump: 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.895 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9538001df0 con 0x7f954013f350 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 1 -- 172.21.15.73:0/2100478362 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9538004f60 con 0x7f954013f350 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 4 set_mon_vals no callback set 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:33.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f953effd640 10 monclient: dump: 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.897 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 10 monclient: shutdown 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 1 -- 172.21.15.73:0/2100478362 >> v1:172.21.15.73:6790/0 conn(0x7f954013f350 legacy=0x7f9540141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 1 -- 172.21.15.73:0/2100478362 shutdown_connections 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 1 -- 172.21.15.73:0/2100478362 >> 172.21.15.73:0/2100478362 conn(0x7f95400a8050 msgr2=0x7f95400a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 1 -- 172.21.15.73:0/2100478362 shutdown_connections 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.883+0000 7f95466bd640 1 -- 172.21.15.73:0/2100478362 wait complete. 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.884+0000 7f95466bd640 10 monclient: build_initial_monmap 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.884+0000 7f95466bd640 10 monclient: monmap: 2024-09-11T01:58:33.898 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:33.899 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.884+0000 7f95466bd640 1 Processor -- start 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 1 -- start start 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 10 monclient: init 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 10 monclient: _add_conns ranks=[7,8,4,0,6,1,3,5,2] 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 10 monclient(hunting): picked mon.noname-i con 0x7f95400a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 10 monclient(hunting): picked mon.noname-e con 0x7f9540138d40 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 10 monclient(hunting): picked mon.noname-c con 0x7f954013f350 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95400a1a20 con 0x7f954013f350 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9540142880 con 0x7f95400a72f0 2024-09-11T01:58:33.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954013a070 con 0x7f9540138d40 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f95466bd640 10 monclient(hunting): authenticate will time out at 755.489490s 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f9544c5a640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f954013f350 0x7f95401d5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49282/0 (socket says 172.21.15.73:49282) 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f9544c5a640 1 -- 172.21.15.73:0/463619553 learned_addr learned my addr 172.21.15.73:0/463619553 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953f7fe640 1 --1- 172.21.15.73:0/463619553 >> v1:172.21.15.73:6793/0 conn(0x7f9540138d40 0x7f95401d2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:37188/0 (socket says 172.21.15.73:37188) 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208808603 0 0) 0x7f95400a1a20 con 0x7f954013f350 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): my global_id is 4405 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f952c003520 con 0x7f954013f350 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2175220734 0 0) 0x7f954013a070 con 0x7f9540138d40 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): my global_id is 4328 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95400a1a20 con 0x7f9540138d40 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 713524226 0 0) 0x7f9540142880 con 0x7f95400a72f0 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 10 monclient(hunting): my global_id is 4363 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.885+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f954013a070 con 0x7f95400a72f0 2024-09-11T01:58:33.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2816258838 0 0) 0x7f952c003520 con 0x7f954013f350 2024-09-11T01:58:33.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9540142880 con 0x7f954013f350 2024-09-11T01:58:33.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f95380013e0 con 0x7f954013f350 2024-09-11T01:58:33.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:33.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:33.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): dump: 2024-09-11T01:58:33.903 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.903 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.903 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.904 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 254601295 0 0) 0x7f95400a1a20 con 0x7f9540138d40 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f952c003520 con 0x7f9540138d40 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9534001a10 con 0x7f9540138d40 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): dump: 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.905 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1656256210 0 0) 0x7f954013a070 con 0x7f95400a72f0 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95400a1a20 con 0x7f95400a72f0 2024-09-11T01:58:33.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f95300014a0 con 0x7f95400a72f0 2024-09-11T01:58:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient(hunting): dump: 2024-09-11T01:58:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.907 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1040049698 0 0) 0x7f9540142880 con 0x7f954013f350 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 >> v1:172.21.15.73:6793/0 conn(0x7f9540138d40 legacy=0x7f95401d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 >> v1:172.21.15.203:6792/0 conn(0x7f95400a72f0 legacy=0x7f954013dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 monclient: found mon.c 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954013c1f0 con 0x7f954013f350 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f95466bd640 5 monclient: authenticate success, global_id 4405 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f95466bd640 10 monclient: _renew_subs 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f95466bd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f954013e6d0 con 0x7f954013f350 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f95466bd640 10 monclient: _renew_subs 2024-09-11T01:58:33.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f95466bd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f954013b470 con 0x7f954013f350 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9538001fc0 con 0x7f954013f350 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9538001cb0 con 0x7f954013f350 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953e7fc640 4 set_mon_vals no callback set 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.886+0000 7f953cff9640 10 monclient: dump: 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:33.910 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.887+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9538011a30 con 0x7f954013f350 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.887+0000 7f95466bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:33.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.887+0000 7f95466bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.887+0000 7f95466bd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.887+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9520005080 con 0x7f954013f350 2024-09-11T01:58:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.887+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7f953804e530 con 0x7f954013f350 2024-09-11T01:58:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.887+0000 7f953ffff640 10 monclient: get_auth_request con 0x7f952c040770 auth_method 0 2024-09-11T01:58:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.891+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f9538017800 con 0x7f954013f350 2024-09-11T01:58:33.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.891+0000 7f953cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:33.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:33.891+0000 7f953cff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.068+0000 7f95466bd640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-09-11T01:58:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.068+0000 7f95466bd640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-09-11T01:58:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.068+0000 7f95466bd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.068+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9520005c40 con 0x7f954013f350 2024-09-11T01:58:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.068+0000 7f953cff9640 1 -- 172.21.15.73:0/463619553 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (unknown 3303410134 0 2170607528) 0x7f953801bb80 con 0x7f954013f350 2024-09-11T01:58:34.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.068+0000 7f953cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-09-11T01:58:34.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.068+0000 7f953cff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:34.071 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-11T01:58:34.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.070+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 >> v1:172.21.15.203:6812/2311533528 conn(0x7f952c040770 legacy=0x7f952c042c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.070+0000 7f95466bd640 10 monclient: shutdown 2024-09-11T01:58:34.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.070+0000 7f95466bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:34.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.070+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 >> v1:172.21.15.73:6791/0 conn(0x7f954013f350 legacy=0x7f95401d5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.071+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 shutdown_connections 2024-09-11T01:58:34.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.071+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 >> 172.21.15.73:0/463619553 conn(0x7f95400a8050 msgr2=0x7f95400a9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:34.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.071+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 shutdown_connections 2024-09-11T01:58:34.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.071+0000 7f95466bd640 1 -- 172.21.15.73:0/463619553 wait complete. 2024-09-11T01:58:34.083 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.181+0000 7fb67a7bb640 10 monclient: get_monmap_and_config 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.181+0000 7fb67a7bb640 10 monclient: build_initial_monmap 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.181+0000 7fb67a7bb640 10 monclient: monmap: 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:34.182269+0000 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:34.182269+0000 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.183 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:34.184 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:34.184 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:34.184 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:34.184 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:34.184 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:34.184 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:34.184 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:34.184 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:34.184 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 1 Processor -- start 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 1 -- start start 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 10 monclient: init 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 10 monclient: _add_conns ranks=[0,2,5,7,8,6,1,3,4] 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 10 monclient(hunting): picked mon.noname-a con 0x7fb674138d40 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 10 monclient(hunting): picked mon.noname-b con 0x7fb6740a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 10 monclient(hunting): picked mon.noname-h con 0x7fb67413f350 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67409ca00 con 0x7fb674138d40 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6740a7070 con 0x7fb6740a72f0 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67409cee0 con 0x7fb67413f350 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:34.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb67a7bb640 10 monclient(hunting): authenticate will time out at 755.786738s 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb673fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb674138d40 0x7fb674139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50470/0 (socket says 172.21.15.73:50470) 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb6737fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb6740a72f0 0x7fb67413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53626/0 (socket says 172.21.15.73:53626) 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.182+0000 7fb673fff640 1 -- 172.21.15.73:0/3110632477 learned_addr learned my addr 172.21.15.73:0/3110632477 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1012326674 0 0) 0x7fb6740a7070 con 0x7fb6740a72f0 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient(hunting): my global_id is 4376 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb660003520 con 0x7fb6740a72f0 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463656945 0 0) 0x7fb67409ca00 con 0x7fb674138d40 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient(hunting): my global_id is 4437 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6740a7070 con 0x7fb674138d40 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 980614624 0 0) 0x7fb660003520 con 0x7fb6740a72f0 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 >> v1:172.21.15.203:6791/0 conn(0x7fb67413f350 legacy=0x7fb674141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 >> v1:172.21.15.73:6789/0 conn(0x7fb674138d40 legacy=0x7fb674139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 monclient: found mon.noname-b 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67409d1c0 con 0x7fb6740a72f0 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:34.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb67a7bb640 5 monclient: authenticate success, global_id 4376 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb65c001830 con 0x7fb6740a72f0 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb67a7bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: dump: 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.195 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb67a7bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:34.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb65c001a50 con 0x7fb6740a72f0 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 1 -- 172.21.15.73:0/3110632477 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb65c004b20 con 0x7fb6740a72f0 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb67a7bb640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb67a7bb640 4 set_mon_vals no callback set 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb672ffd640 10 monclient: dump: 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.197 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb67a7bb640 10 monclient: shutdown 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb67a7bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb67a7bb640 1 -- 172.21.15.73:0/3110632477 >> v1:172.21.15.73:6790/0 conn(0x7fb6740a72f0 legacy=0x7fb67413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.183+0000 7fb67a7bb640 1 -- 172.21.15.73:0/3110632477 shutdown_connections 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.184+0000 7fb67a7bb640 1 -- 172.21.15.73:0/3110632477 >> 172.21.15.73:0/3110632477 conn(0x7fb6740a8050 msgr2=0x7fb6740a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.184+0000 7fb67a7bb640 1 -- 172.21.15.73:0/3110632477 shutdown_connections 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.184+0000 7fb67a7bb640 1 -- 172.21.15.73:0/3110632477 wait complete. 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.184+0000 7fb67a7bb640 10 monclient: build_initial_monmap 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.184+0000 7fb67a7bb640 10 monclient: monmap: 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:34.199 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.184+0000 7fb67a7bb640 1 Processor -- start 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 1 -- start start 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 10 monclient: init 2024-09-11T01:58:34.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 10 monclient: _add_conns ranks=[7,5,1,0,3,8,4,6,2] 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 10 monclient(hunting): picked mon.noname-i con 0x7fb6740a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 10 monclient(hunting): picked mon.noname-h con 0x7fb674138d40 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 10 monclient(hunting): picked mon.noname-f con 0x7fb67413f350 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb674142760 con 0x7fb67413f350 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6740a1590 con 0x7fb674138d40 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6740a1870 con 0x7fb6740a72f0 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb67a7bb640 10 monclient(hunting): authenticate will time out at 755.789514s 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb6737fe640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7fb674138d40 0x7fb67409f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.73:55354/0 (socket says 172.21.15.73:55354) 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb6737fe640 1 -- 172.21.15.73:0/1604392172 learned_addr learned my addr 172.21.15.73:0/1604392172 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297435473 0 0) 0x7fb67409cee0 con 0x7fb67413f350 2024-09-11T01:58:34.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): my global_id is 4357 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb654003550 con 0x7fb67413f350 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057645845 0 0) 0x7fb6740a1590 con 0x7fb674138d40 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): my global_id is 4406 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb67409cee0 con 0x7fb674138d40 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610667024 0 0) 0x7fb6740a1870 con 0x7fb6740a72f0 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.185+0000 7fb670ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): my global_id is 4372 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6740a1590 con 0x7fb6740a72f0 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1094512289 0 0) 0x7fb654003550 con 0x7fb67413f350 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6740a1870 con 0x7fb67413f350 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb66c001cc0 con 0x7fb67413f350 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.203 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.204 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2514992955 0 0) 0x7fb67409cee0 con 0x7fb674138d40 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb654003550 con 0x7fb674138d40 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3373165512 0 0) 0x7fb6740a1590 con 0x7fb6740a72f0 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb67409cee0 con 0x7fb6740a72f0 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb65c0017f0 con 0x7fb674138d40 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:34.205 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.206 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb664001550 con 0x7fb6740a72f0 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.207 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.208 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1957747877 0 0) 0x7fb6740a1870 con 0x7fb67413f350 2024-09-11T01:58:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 >> v1:172.21.15.203:6792/0 conn(0x7fb6740a72f0 legacy=0x7fb67409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 >> v1:172.21.15.203:6791/0 conn(0x7fb674138d40 legacy=0x7fb67409f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 monclient: found mon.f 2024-09-11T01:58:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:34.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67409fa60 con 0x7fb67413f350 2024-09-11T01:58:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb67a7bb640 5 monclient: authenticate success, global_id 4357 2024-09-11T01:58:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb67a7bb640 10 monclient: _renew_subs 2024-09-11T01:58:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb67a7bb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:34.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6740a5200 con 0x7fb67413f350 2024-09-11T01:58:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb67a7bb640 10 monclient: _renew_subs 2024-09-11T01:58:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb67a7bb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6740a1ba0 con 0x7fb67413f350 2024-09-11T01:58:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb66c003970 con 0x7fb67413f350 2024-09-11T01:58:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb66c003ee0 con 0x7fb67413f350 2024-09-11T01:58:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:34.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb6727fc640 4 set_mon_vals no callback set 2024-09-11T01:58:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.186+0000 7fb670ff9640 10 monclient: dump: 2024-09-11T01:58:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.212 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.213 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.214 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.187+0000 7fb67a7bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.187+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fb66c004080 con 0x7fb67413f350 2024-09-11T01:58:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.187+0000 7fb67a7bb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.187+0000 7fb67a7bb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.187+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb658005080 con 0x7fb67413f350 2024-09-11T01:58:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.187+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7fb66c04d2e0 con 0x7fb67413f350 2024-09-11T01:58:34.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.187+0000 7fb673fff640 10 monclient: get_auth_request con 0x7fb654040790 auth_method 0 2024-09-11T01:58:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.192+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fb674142760 con 0x7fb67413f350 2024-09-11T01:58:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.192+0000 7fb670ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:34.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.192+0000 7fb670ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:34.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.366+0000 7fb67a7bb640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-09-11T01:58:34.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.366+0000 7fb67a7bb640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-09-11T01:58:34.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.366+0000 7fb67a7bb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:58:34.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.366+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 --> v1:172.21.15.203:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7fb658005c40 con 0x7fb67413f350 2024-09-11T01:58:34.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.367+0000 7fb670ff9640 1 -- 172.21.15.73:0/1604392172 <== mon.1 v1:172.21.15.203:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) ==== 92+0+10 (unknown 4161178158 0 265718887) 0x7fb66c0165b0 con 0x7fb67413f350 2024-09-11T01:58:34.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.367+0000 7fb670ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-09-11T01:58:34.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.367+0000 7fb670ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:34.369 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-09-11T01:58:34.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.369+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 >> v1:172.21.15.203:6812/2311533528 conn(0x7fb654040790 legacy=0x7fb654042c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.369+0000 7fb67a7bb640 10 monclient: shutdown 2024-09-11T01:58:34.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.369+0000 7fb67a7bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:34.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.369+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 >> v1:172.21.15.203:6789/0 conn(0x7fb67413f350 legacy=0x7fb6741d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.369+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 shutdown_connections 2024-09-11T01:58:34.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.369+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 >> 172.21.15.73:0/1604392172 conn(0x7fb6740a8050 msgr2=0x7fb67413ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:34.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.369+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 shutdown_connections 2024-09-11T01:58:34.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.369+0000 7fb67a7bb640 1 -- 172.21.15.73:0/1604392172 wait complete. 2024-09-11T01:58:34.382 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-11T01:58:34.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:58:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.477+0000 7f68e8472640 10 monclient: get_monmap_and_config 2024-09-11T01:58:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.477+0000 7f68e8472640 10 monclient: build_initial_monmap 2024-09-11T01:58:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.477+0000 7f68e8472640 10 monclient: monmap: 2024-09-11T01:58:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:34.478594+0000 2024-09-11T01:58:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:34.478594+0000 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:34.480 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 1 Processor -- start 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 1 -- start start 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 10 monclient: init 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 10 monclient: _add_conns ranks=[2,0,3,4,8,5,1,7,6] 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 10 monclient(hunting): picked mon.noname-b con 0x7f68e0138d40 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 10 monclient(hunting): picked mon.noname-a con 0x7f68e00a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 10 monclient(hunting): picked mon.noname-g con 0x7f68e013f350 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68e009ca00 con 0x7f68e00a72f0 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68e00a7070 con 0x7f68e0138d40 2024-09-11T01:58:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68e009cee0 con 0x7f68e013f350 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.478+0000 7f68e8472640 10 monclient(hunting): authenticate will time out at 756.083000s 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e620e640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f68e0138d40 0x7f68e0139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53630/0 (socket says 172.21.15.73:53630) 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e5a0d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f68e00a72f0 0x7f68e013dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50474/0 (socket says 172.21.15.73:50474) 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e620e640 1 -- 172.21.15.73:0/3024804613 learned_addr learned my addr 172.21.15.73:0/3024804613 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3551478781 0 0) 0x7f68e009ca00 con 0x7f68e00a72f0 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient(hunting): my global_id is 4446 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68cc003520 con 0x7f68e00a72f0 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173108112 0 0) 0x7f68e00a7070 con 0x7f68e0138d40 2024-09-11T01:58:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient(hunting): my global_id is 4385 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68e009ca00 con 0x7f68e0138d40 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1441377482 0 0) 0x7f68cc003520 con 0x7f68e00a72f0 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 >> v1:172.21.15.203:6790/0 conn(0x7f68e013f350 legacy=0x7f68e0141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 >> v1:172.21.15.73:6790/0 conn(0x7f68e0138d40 legacy=0x7f68e0139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: _finish_hunting 0 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 monclient: found mon.noname-a 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e009d1c0 con 0x7f68e00a72f0 2024-09-11T01:58:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: _finish_auth 0 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: _check_auth_tickets 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f68d0001850 con 0x7f68e00a72f0 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: dump: 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e8472640 5 monclient: authenticate success, global_id 4446 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e8472640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68d0001a70 con 0x7f68e00a72f0 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 1 -- 172.21.15.73:0/3024804613 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f68d0004b20 con 0x7f68e00a72f0 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e520c640 10 monclient: dump: 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e8472640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.479+0000 7f68e8472640 4 set_mon_vals no callback set 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.480+0000 7f68e8472640 10 monclient: shutdown 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.480+0000 7f68e8472640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.480+0000 7f68e8472640 1 -- 172.21.15.73:0/3024804613 >> v1:172.21.15.73:6789/0 conn(0x7f68e00a72f0 legacy=0x7f68e013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.480+0000 7f68e8472640 1 -- 172.21.15.73:0/3024804613 shutdown_connections 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.480+0000 7f68e8472640 1 -- 172.21.15.73:0/3024804613 >> 172.21.15.73:0/3024804613 conn(0x7f68e00a8050 msgr2=0x7f68e00a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.480+0000 7f68e8472640 1 -- 172.21.15.73:0/3024804613 shutdown_connections 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.480+0000 7f68e8472640 1 -- 172.21.15.73:0/3024804613 wait complete. 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.480+0000 7f68e8472640 10 monclient: build_initial_monmap 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.480+0000 7f68e8472640 10 monclient: monmap: 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 1 Processor -- start 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 1 -- start start 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 10 monclient: init 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 10 monclient: _add_conns ranks=[2,7,3,8,5,6,4,0,1] 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 10 monclient(hunting): picked mon.noname-b con 0x7f68e00a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 10 monclient(hunting): picked mon.noname-i con 0x7f68e0138d40 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 10 monclient(hunting): picked mon.noname-g con 0x7f68e013f350 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68e013e5d0 con 0x7f68e00a72f0 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68e013b620 con 0x7f68e013f350 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68e00a5230 con 0x7f68e0138d40 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e8472640 10 monclient(hunting): authenticate will time out at 756.085711s 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e620e640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f68e00a72f0 0x7f68e0140730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53638/0 (socket says 172.21.15.73:53638) 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68e620e640 1 -- 172.21.15.73:0/4114732925 learned_addr learned my addr 172.21.15.73:0/4114732925 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238158961 0 0) 0x7f68e013e5d0 con 0x7f68e00a72f0 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68d6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68d6ffd640 10 monclient(hunting): my global_id is 4394 2024-09-11T01:58:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.481+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68c4003520 con 0x7f68e00a72f0 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 382716052 0 0) 0x7f68c4003520 con 0x7f68e00a72f0 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68e013e5d0 con 0x7f68e00a72f0 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f68dc001bb0 con 0x7f68e00a72f0 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.498 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747029772 0 0) 0x7f68e013b620 con 0x7f68e013f350 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): my global_id is 4440 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68c4003520 con 0x7f68e013f350 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706376183 0 0) 0x7f68e00a5230 con 0x7f68e0138d40 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient(hunting): my global_id is 4381 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68e013b620 con 0x7f68e0138d40 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 36486781 0 0) 0x7f68e013e5d0 con 0x7f68e00a72f0 2024-09-11T01:58:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 >> v1:172.21.15.203:6792/0 conn(0x7f68e0138d40 legacy=0x7f68e0140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 >> v1:172.21.15.203:6790/0 conn(0x7f68e013f350 legacy=0x7f68e01d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 monclient: found mon.b 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e01420a0 con 0x7f68e00a72f0 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68e8472640 5 monclient: authenticate success, global_id 4394 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68e8472640 10 monclient: _renew_subs 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68e8472640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68e0141550 con 0x7f68e00a72f0 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68e8472640 10 monclient: _renew_subs 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68e8472640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f68e0139e20 con 0x7f68e00a72f0 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68dc004a90 con 0x7f68e00a72f0 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f68dc004f80 con 0x7f68e00a72f0 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68e4a0b640 4 set_mon_vals no callback set 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.482+0000 7f68d6ffd640 10 monclient: dump: 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.501 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.483+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f68dc0116c0 con 0x7f68e00a72f0 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.483+0000 7f68e8472640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:34.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.483+0000 7f68e8472640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:34.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.483+0000 7f68e8472640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:34.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.483+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c8005080 con 0x7f68e00a72f0 2024-09-11T01:58:34.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.483+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7f68dc04e350 con 0x7f68e00a72f0 2024-09-11T01:58:34.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.483+0000 7f68e5a0d640 10 monclient: get_auth_request con 0x7f68c403ff30 auth_method 0 2024-09-11T01:58:34.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.488+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f68dc0177c0 con 0x7f68e00a72f0 2024-09-11T01:58:34.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.488+0000 7f68d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:34.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.488+0000 7f68d6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:34.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.662+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68c8000b90 con 0x7f68c403ff30 2024-09-11T01:58:34.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.663+0000 7f68d6ffd640 1 -- 172.21.15.73:0/4114732925 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34198 (unknown 2965378022 0 1697346903) 0x7f68c8000b90 con 0x7f68c403ff30 2024-09-11T01:58:34.665 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:34.665 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-11T01:58:34.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.665+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 >> v1:172.21.15.203:6812/2311533528 conn(0x7f68c403ff30 legacy=0x7f68c40423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.665+0000 7f68e8472640 10 monclient: shutdown 2024-09-11T01:58:34.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.665+0000 7f68e8472640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:34.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.665+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 >> v1:172.21.15.73:6790/0 conn(0x7f68e00a72f0 legacy=0x7f68e0140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.665+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 shutdown_connections 2024-09-11T01:58:34.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.665+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 >> 172.21.15.73:0/4114732925 conn(0x7f68e00a8050 msgr2=0x7f68e013ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.665+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 shutdown_connections 2024-09-11T01:58:34.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.665+0000 7f68e8472640 1 -- 172.21.15.73:0/4114732925 wait complete. 2024-09-11T01:58:34.678 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-11T01:58:32.881222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163328,"kb_used_data":1120,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067712,"statfs":{"total":579820584960,"available":579653337088,"internally_reserved":0,"allocated":1146880,"data_stored":1386100,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.896307"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988312+0000","last_change":"2024-09-11T01:58:28.988312+0000","last_active":"2024-09-11T01:58:28.988312+0000","last_peered":"2024-09-11T01:58:28.988312+0000","last_clean":"2024-09-11T01:58:28.988312+0000","last_became_active":"2024-09-11T01:58:27.047814+0000","last_became_peered":"2024-09-11T01:58:27.047814+0000","last_unstale":"2024-09-11T01:58:28.988312+0000","last_undegraded":"2024-09-11T01:58:28.988312+0000","last_fullsized":"2024-09-11T01:58:28.988312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:15.861207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040037900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.994316+0000","last_change":"2024-09-11T01:58:28.994589+0000","last_active":"2024-09-11T01:58:28.994316+0000","last_peered":"2024-09-11T01:58:28.994316+0000","last_clean":"2024-09-11T01:58:28.994316+0000","last_became_active":"2024-09-11T01:58:26.989307+0000","last_became_peered":"2024-09-11T01:58:26.989307+0000","last_unstale":"2024-09-11T01:58:28.994316+0000","last_undegraded":"2024-09-11T01:58:28.994316+0000","last_fullsized":"2024-09-11T01:58:28.994316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:05.162449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001059894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988266+0000","last_change":"2024-09-11T01:58:28.988266+0000","last_active":"2024-09-11T01:58:28.988266+0000","last_peered":"2024-09-11T01:58:28.988266+0000","last_clean":"2024-09-11T01:58:28.988266+0000","last_became_active":"2024-09-11T01:58:26.991911+0000","last_became_peered":"2024-09-11T01:58:26.991911+0000","last_unstale":"2024-09-11T01:58:28.988266+0000","last_undegraded":"2024-09-11T01:58:28.988266+0000","last_fullsized":"2024-09-11T01:58:28.988266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:11.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051120699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.994362+0000","last_change":"2024-09-11T01:58:28.994578+0000","last_active":"2024-09-11T01:58:28.994362+0000","last_peered":"2024-09-11T01:58:28.994362+0000","last_clean":"2024-09-11T01:58:28.994362+0000","last_became_active":"2024-09-11T01:58:26.989353+0000","last_became_peered":"2024-09-11T01:58:26.989353+0000","last_unstale":"2024-09-11T01:58:28.994362+0000","last_undegraded":"2024-09-11T01:58:28.994362+0000","last_fullsized":"2024-09-11T01:58:28.994362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:37.795438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010300419999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.997622+0000","last_change":"2024-09-11T01:58:28.992277+0000","last_active":"2024-09-11T01:58:28.997622+0000","last_peered":"2024-09-11T01:58:28.997622+0000","last_clean":"2024-09-11T01:58:28.997622+0000","last_became_active":"2024-09-11T01:58:26.992547+0000","last_became_peered":"2024-09-11T01:58:26.992547+0000","last_unstale":"2024-09-11T01:58:28.997622+0000","last_undegraded":"2024-09-11T01:58:28.997622+0000","last_fullsized":"2024-09-11T01:58:28.997622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:48.184504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707749999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988691+0000","last_change":"2024-09-11T01:58:28.988691+0000","last_active":"2024-09-11T01:58:28.988691+0000","last_peered":"2024-09-11T01:58:28.988691+0000","last_clean":"2024-09-11T01:58:28.988691+0000","last_became_active":"2024-09-11T01:58:26.989539+0000","last_became_peered":"2024-09-11T01:58:26.989539+0000","last_unstale":"2024-09-11T01:58:28.988691+0000","last_undegraded":"2024-09-11T01:58:28.988691+0000","last_fullsized":"2024-09-11T01:58:28.988691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:05.294029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063444800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988518+0000","last_change":"2024-09-11T01:58:28.988518+0000","last_active":"2024-09-11T01:58:28.988518+0000","last_peered":"2024-09-11T01:58:28.988518+0000","last_clean":"2024-09-11T01:58:28.988518+0000","last_became_active":"2024-09-11T01:58:26.992110+0000","last_became_peered":"2024-09-11T01:58:26.992110+0000","last_unstale":"2024-09-11T01:58:28.988518+0000","last_undegraded":"2024-09-11T01:58:28.988518+0000","last_fullsized":"2024-09-11T01:58:28.988518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:47.916474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058377799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.991608+0000","last_change":"2024-09-11T01:58:28.991608+0000","last_active":"2024-09-11T01:58:28.991608+0000","last_peered":"2024-09-11T01:58:28.991608+0000","last_clean":"2024-09-11T01:58:28.991608+0000","last_became_active":"2024-09-11T01:58:26.992862+0000","last_became_peered":"2024-09-11T01:58:26.992862+0000","last_unstale":"2024-09-11T01:58:28.991608+0000","last_undegraded":"2024-09-11T01:58:28.991608+0000","last_fullsized":"2024-09-11T01:58:28.991608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:02.837285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038950200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.987629+0000","last_change":"2024-09-11T01:58:22.348806+0000","last_active":"2024-09-11T01:58:28.987629+0000","last_peered":"2024-09-11T01:58:28.987629+0000","last_clean":"2024-09-11T01:58:28.987629+0000","last_became_active":"2024-09-11T01:58:22.347800+0000","last_became_peered":"2024-09-11T01:58:22.347800+0000","last_unstale":"2024-09-11T01:58:28.987629+0000","last_undegraded":"2024-09-11T01:58:28.987629+0000","last_fullsized":"2024-09-11T01:58:28.987629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_clean_scrub_stamp":"2024-09-11T01:58:20.928503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:37.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":176128,"data_stored":54720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":54701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":54701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":583629,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":583629,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":176128,"data_stored":54720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:58:34.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T01:58:34.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.774+0000 7fbfdce60640 10 monclient: get_monmap_and_config 2024-09-11T01:58:34.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.774+0000 7fbfdce60640 10 monclient: build_initial_monmap 2024-09-11T01:58:34.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.774+0000 7fbfdce60640 10 monclient: monmap: 2024-09-11T01:58:34.784 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:34.775529+0000 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:34.775529+0000 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:34.785 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 1 Processor -- start 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 1 -- start start 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 10 monclient: init 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 10 monclient: _add_conns ranks=[8,1,4,6,5,3,7,2,0] 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 10 monclient(hunting): picked mon.noname-e con 0x7fbfd8138d40 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 10 monclient(hunting): picked mon.noname-f con 0x7fbfd80a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 10 monclient(hunting): picked mon.noname-c con 0x7fbfd813f350 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd809ca00 con 0x7fbfd80a72f0 2024-09-11T01:58:34.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd80a7070 con 0x7fbfd813f350 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd809cee0 con 0x7fbfd8138d40 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfdce60640 10 monclient(hunting): authenticate will time out at 756.379781s 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfd659c640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fbfd8138d40 0x7fbfd8139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:37204/0 (socket says 172.21.15.73:37204) 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.775+0000 7fbfd659c640 1 -- 172.21.15.73:0/468839498 learned_addr learned my addr 172.21.15.73:0/468839498 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206820579 0 0) 0x7fbfd80a7070 con 0x7fbfd813f350 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient(hunting): my global_id is 4414 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc4003520 con 0x7fbfd813f350 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394439653 0 0) 0x7fbfd809cee0 con 0x7fbfd8138d40 2024-09-11T01:58:34.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient(hunting): my global_id is 4337 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfd80a7070 con 0x7fbfd8138d40 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3155767601 0 0) 0x7fbfc4003520 con 0x7fbfd813f350 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 >> v1:172.21.15.73:6793/0 conn(0x7fbfd8138d40 legacy=0x7fbfd8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 >> v1:172.21.15.203:6789/0 conn(0x7fbfd80a72f0 legacy=0x7fbfd813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: _finish_hunting 0 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 monclient: found mon.noname-c 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T01:58:34.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd809d1c0 con 0x7fbfd813f350 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: _finish_auth 0 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: _check_auth_tickets 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbfd0001bb0 con 0x7fbfd813f350 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfdce60640 5 monclient: authenticate success, global_id 4414 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfdce60640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: dump: 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.789 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfdce60640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbfd0001dd0 con 0x7fbfd813f350 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 1 -- 172.21.15.73:0/468839498 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbfd0003cd0 con 0x7fbfd813f350 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfd5d9b640 10 monclient: dump: 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.791 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfdce60640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfdce60640 4 set_mon_vals no callback set 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfdce60640 10 monclient: shutdown 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfdce60640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:34.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.776+0000 7fbfdce60640 1 -- 172.21.15.73:0/468839498 >> v1:172.21.15.73:6791/0 conn(0x7fbfd813f350 legacy=0x7fbfd8141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.777+0000 7fbfdce60640 1 -- 172.21.15.73:0/468839498 shutdown_connections 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.777+0000 7fbfdce60640 1 -- 172.21.15.73:0/468839498 >> 172.21.15.73:0/468839498 conn(0x7fbfd80a8050 msgr2=0x7fbfd80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.777+0000 7fbfdce60640 1 -- 172.21.15.73:0/468839498 shutdown_connections 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.777+0000 7fbfdce60640 1 -- 172.21.15.73:0/468839498 wait complete. 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.777+0000 7fbfdce60640 10 monclient: build_initial_monmap 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.777+0000 7fbfdce60640 10 monclient: monmap: 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:34.793 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 1 Processor -- start 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 1 -- start start 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 10 monclient: init 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 10 monclient: _add_conns ranks=[7,3,6,8,2,4,0,5,1] 2024-09-11T01:58:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 10 monclient(hunting): picked mon.noname-i con 0x7fbfd80a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 10 monclient(hunting): picked mon.noname-g con 0x7fbfd8138d40 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 10 monclient(hunting): picked mon.noname-d con 0x7fbfd813f350 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd81427f0 con 0x7fbfd8138d40 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd809fa60 con 0x7fbfd813f350 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd80a5280 con 0x7fbfd80a72f0 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfdce60640 10 monclient(hunting): authenticate will time out at 756.382815s 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfd6d9d640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fbfd813f350 0x7fbfd81d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:35122/0 (socket says 172.21.15.73:35122) 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.778+0000 7fbfd6d9d640 1 -- 172.21.15.73:0/3076994024 learned_addr learned my addr 172.21.15.73:0/3076994024 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962410225 0 0) 0x7fbfd809fa60 con 0x7fbfd813f350 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): my global_id is 4353 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfb8003550 con 0x7fbfd813f350 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661183877 0 0) 0x7fbfd81427f0 con 0x7fbfd8138d40 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): my global_id is 4449 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfd809fa60 con 0x7fbfd8138d40 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1908532948 0 0) 0x7fbfd80a5280 con 0x7fbfd80a72f0 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:34.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): my global_id is 4390 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfd81427f0 con 0x7fbfd80a72f0 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 160637719 0 0) 0x7fbfb8003550 con 0x7fbfd813f350 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfd80a5280 con 0x7fbfd813f350 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbfd0003cb0 con 0x7fbfd813f350 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): dump: 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.797 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:34.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3642968762 0 0) 0x7fbfd80a5280 con 0x7fbfd813f350 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 >> v1:172.21.15.203:6792/0 conn(0x7fbfd80a72f0 legacy=0x7fbfd809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 >> v1:172.21.15.203:6790/0 conn(0x7fbfd8138d40 legacy=0x7fbfd809f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 monclient: found mon.d 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd80a0260 con 0x7fbfd813f350 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfdce60640 5 monclient: authenticate success, global_id 4353 2024-09-11T01:58:34.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfdce60640 10 monclient: _renew_subs 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfdce60640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd80a1640 con 0x7fbfd813f350 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfdce60640 10 monclient: _renew_subs 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfdce60640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbfd80a08e0 con 0x7fbfd813f350 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbfd0001b90 con 0x7fbfd813f350 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbfd0004210 con 0x7fbfd813f350 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfd559a640 4 set_mon_vals no callback set 2024-09-11T01:58:34.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.779+0000 7fbfcf7fe640 10 monclient: dump: 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.780+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fbfd0004430 con 0x7fbfd813f350 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.780+0000 7fbfdce60640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.780+0000 7fbfdce60640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.780+0000 7fbfdce60640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.780+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfbc005080 con 0x7fbfd813f350 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.780+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7fbfd004e460 con 0x7fbfd813f350 2024-09-11T01:58:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.780+0000 7fbfd659c640 10 monclient: get_auth_request con 0x7fbfb803fe50 auth_method 0 2024-09-11T01:58:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.785+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fbfd0017870 con 0x7fbfd813f350 2024-09-11T01:58:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.785+0000 7fbfcf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.785+0000 7fbfcf7fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:34.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.958+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbfbc000b90 con 0x7fbfb803fe50 2024-09-11T01:58:34.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.959+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/3076994024 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34174 (unknown 2965378022 0 878352078) 0x7fbfbc000b90 con 0x7fbfb803fe50 2024-09-11T01:58:34.961 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T01:58:34.961 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-11T01:58:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.961+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 >> v1:172.21.15.203:6812/2311533528 conn(0x7fbfb803fe50 legacy=0x7fbfb8042310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.961+0000 7fbfdce60640 10 monclient: shutdown 2024-09-11T01:58:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.961+0000 7fbfdce60640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.961+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 >> v1:172.21.15.73:6792/0 conn(0x7fbfd813f350 legacy=0x7fbfd81d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.961+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 shutdown_connections 2024-09-11T01:58:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.961+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 >> 172.21.15.73:0/3076994024 conn(0x7fbfd80a8050 msgr2=0x7fbfd813ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.961+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 shutdown_connections 2024-09-11T01:58:34.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:34.961+0000 7fbfdce60640 1 -- 172.21.15.73:0/3076994024 wait complete. 2024-09-11T01:58:34.973 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-11T01:58:34.881594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163328,"kb_used_data":1120,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067712,"statfs":{"total":579820584960,"available":579653337088,"internally_reserved":0,"allocated":1146880,"data_stored":1386100,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.897858"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988312+0000","last_change":"2024-09-11T01:58:28.988312+0000","last_active":"2024-09-11T01:58:28.988312+0000","last_peered":"2024-09-11T01:58:28.988312+0000","last_clean":"2024-09-11T01:58:28.988312+0000","last_became_active":"2024-09-11T01:58:27.047814+0000","last_became_peered":"2024-09-11T01:58:27.047814+0000","last_unstale":"2024-09-11T01:58:28.988312+0000","last_undegraded":"2024-09-11T01:58:28.988312+0000","last_fullsized":"2024-09-11T01:58:28.988312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:15.861207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040037900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.994316+0000","last_change":"2024-09-11T01:58:28.994589+0000","last_active":"2024-09-11T01:58:28.994316+0000","last_peered":"2024-09-11T01:58:28.994316+0000","last_clean":"2024-09-11T01:58:28.994316+0000","last_became_active":"2024-09-11T01:58:26.989307+0000","last_became_peered":"2024-09-11T01:58:26.989307+0000","last_unstale":"2024-09-11T01:58:28.994316+0000","last_undegraded":"2024-09-11T01:58:28.994316+0000","last_fullsized":"2024-09-11T01:58:28.994316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:05.162449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001059894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988266+0000","last_change":"2024-09-11T01:58:28.988266+0000","last_active":"2024-09-11T01:58:28.988266+0000","last_peered":"2024-09-11T01:58:28.988266+0000","last_clean":"2024-09-11T01:58:28.988266+0000","last_became_active":"2024-09-11T01:58:26.991911+0000","last_became_peered":"2024-09-11T01:58:26.991911+0000","last_unstale":"2024-09-11T01:58:28.988266+0000","last_undegraded":"2024-09-11T01:58:28.988266+0000","last_fullsized":"2024-09-11T01:58:28.988266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:11.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051120699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.994362+0000","last_change":"2024-09-11T01:58:28.994578+0000","last_active":"2024-09-11T01:58:28.994362+0000","last_peered":"2024-09-11T01:58:28.994362+0000","last_clean":"2024-09-11T01:58:28.994362+0000","last_became_active":"2024-09-11T01:58:26.989353+0000","last_became_peered":"2024-09-11T01:58:26.989353+0000","last_unstale":"2024-09-11T01:58:28.994362+0000","last_undegraded":"2024-09-11T01:58:28.994362+0000","last_fullsized":"2024-09-11T01:58:28.994362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:37.795438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010300419999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.997622+0000","last_change":"2024-09-11T01:58:28.992277+0000","last_active":"2024-09-11T01:58:28.997622+0000","last_peered":"2024-09-11T01:58:28.997622+0000","last_clean":"2024-09-11T01:58:28.997622+0000","last_became_active":"2024-09-11T01:58:26.992547+0000","last_became_peered":"2024-09-11T01:58:26.992547+0000","last_unstale":"2024-09-11T01:58:28.997622+0000","last_undegraded":"2024-09-11T01:58:28.997622+0000","last_fullsized":"2024-09-11T01:58:28.997622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:48.184504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707749999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988691+0000","last_change":"2024-09-11T01:58:28.988691+0000","last_active":"2024-09-11T01:58:28.988691+0000","last_peered":"2024-09-11T01:58:28.988691+0000","last_clean":"2024-09-11T01:58:28.988691+0000","last_became_active":"2024-09-11T01:58:26.989539+0000","last_became_peered":"2024-09-11T01:58:26.989539+0000","last_unstale":"2024-09-11T01:58:28.988691+0000","last_undegraded":"2024-09-11T01:58:28.988691+0000","last_fullsized":"2024-09-11T01:58:28.988691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:05.294029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063444800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.988518+0000","last_change":"2024-09-11T01:58:28.988518+0000","last_active":"2024-09-11T01:58:28.988518+0000","last_peered":"2024-09-11T01:58:28.988518+0000","last_clean":"2024-09-11T01:58:28.988518+0000","last_became_active":"2024-09-11T01:58:26.992110+0000","last_became_peered":"2024-09-11T01:58:26.992110+0000","last_unstale":"2024-09-11T01:58:28.988518+0000","last_undegraded":"2024-09-11T01:58:28.988518+0000","last_fullsized":"2024-09-11T01:58:28.988518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:47.916474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058377799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.991608+0000","last_change":"2024-09-11T01:58:28.991608+0000","last_active":"2024-09-11T01:58:28.991608+0000","last_peered":"2024-09-11T01:58:28.991608+0000","last_clean":"2024-09-11T01:58:28.991608+0000","last_became_active":"2024-09-11T01:58:26.992862+0000","last_became_peered":"2024-09-11T01:58:26.992862+0000","last_unstale":"2024-09-11T01:58:28.991608+0000","last_undegraded":"2024-09-11T01:58:28.991608+0000","last_fullsized":"2024-09-11T01:58:28.991608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:02.837285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038950200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T01:58:28.987629+0000","last_change":"2024-09-11T01:58:22.348806+0000","last_active":"2024-09-11T01:58:28.987629+0000","last_peered":"2024-09-11T01:58:28.987629+0000","last_clean":"2024-09-11T01:58:28.987629+0000","last_became_active":"2024-09-11T01:58:22.347800+0000","last_became_peered":"2024-09-11T01:58:22.347800+0000","last_unstale":"2024-09-11T01:58:28.987629+0000","last_undegraded":"2024-09-11T01:58:28.987629+0000","last_fullsized":"2024-09-11T01:58:28.987629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_clean_scrub_stamp":"2024-09-11T01:58:20.928503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:37.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":176128,"data_stored":54720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":54701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":54701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":583629,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607557,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":583629,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":176128,"data_stored":54720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:58:34.974 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-11T01:58:34.974 DEBUG:tasks.mon_thrash:Yielding 2024-09-11T01:58:34.974 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T01:58:34.984 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T01:58:34.984 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T01:58:34.984 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:58:34.984 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-11T01:58:34.984 INFO:tasks.mon_thrash.mon_thrasher:seed: 1726019914, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-11T01:58:34.985 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-11T01:58:34.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.083+0000 7f9264e65640 10 monclient: get_monmap_and_config 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.083+0000 7f9264e65640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.083+0000 7f9264e65640 10 monclient: monmap: 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:35.084128+0000 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:35.084128+0000 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.085 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.086 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.086 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.086 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.086 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.086 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.086 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.086 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.086 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.086 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.083+0000 7f9264e65640 1 Processor -- start 2024-09-11T01:58:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.083+0000 7f9264e65640 1 -- start start 2024-09-11T01:58:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.083+0000 7f9264e65640 10 monclient: init 2024-09-11T01:58:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 10 monclient: _add_conns ranks=[7,5,3,8,0,6,2,1,4] 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 10 monclient(hunting): picked mon.noname-i con 0x7f9260138d40 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 10 monclient(hunting): picked mon.noname-h con 0x7f92600a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 10 monclient(hunting): picked mon.noname-g con 0x7f926013f350 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926009ca00 con 0x7f926013f350 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92600a7070 con 0x7f92600a72f0 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926009cee0 con 0x7f9260138d40 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f9264e65640 10 monclient(hunting): authenticate will time out at 756.688530s 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f925dd9b640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7f92600a72f0 0x7f926013dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.73:55370/0 (socket says 172.21.15.73:55370) 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.084+0000 7f925dd9b640 1 -- 172.21.15.73:0/1297474935 learned_addr learned my addr 172.21.15.73:0/1297474935 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951605438 0 0) 0x7f92600a7070 con 0x7f92600a72f0 2024-09-11T01:58:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): my global_id is 4442 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f924c003520 con 0x7f92600a72f0 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809759419 0 0) 0x7f926009cee0 con 0x7f9260138d40 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): my global_id is 4399 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92600a7070 con 0x7f9260138d40 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304978976 0 0) 0x7f926009ca00 con 0x7f926013f350 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient(hunting): my global_id is 4476 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f926009cee0 con 0x7f926013f350 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3629167537 0 0) 0x7f924c003520 con 0x7f92600a72f0 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 >> v1:172.21.15.203:6792/0 conn(0x7f9260138d40 legacy=0x7f9260139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 >> v1:172.21.15.203:6790/0 conn(0x7f926013f350 legacy=0x7f9260141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 monclient: found mon.noname-h 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.203:6791/0 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926009d1c0 con 0x7f92600a72f0 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f9264e65640 5 monclient: authenticate success, global_id 4442 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f9264e65640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9248001830 con 0x7f92600a72f0 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: dump: 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f9264e65640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 <== mon.5 v1:172.21.15.203:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9248001a50 con 0x7f92600a72f0 2024-09-11T01:58:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f9264e65640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f9264e65640 4 set_mon_vals no callback set 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 1 -- 172.21.15.73:0/1297474935 <== mon.5 v1:172.21.15.203:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9248004be0 con 0x7f92600a72f0 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.085+0000 7f925d59a640 10 monclient: dump: 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.086+0000 7f9264e65640 10 monclient: shutdown 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.086+0000 7f9264e65640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.086+0000 7f9264e65640 1 -- 172.21.15.73:0/1297474935 >> v1:172.21.15.203:6791/0 conn(0x7f92600a72f0 legacy=0x7f926013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.086+0000 7f9264e65640 1 -- 172.21.15.73:0/1297474935 shutdown_connections 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.086+0000 7f9264e65640 1 -- 172.21.15.73:0/1297474935 >> 172.21.15.73:0/1297474935 conn(0x7f92600a8050 msgr2=0x7f92600a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.086+0000 7f9264e65640 1 -- 172.21.15.73:0/1297474935 shutdown_connections 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.086+0000 7f9264e65640 1 -- 172.21.15.73:0/1297474935 wait complete. 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.086+0000 7f9264e65640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.086+0000 7f9264e65640 10 monclient: monmap: 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 1 Processor -- start 2024-09-11T01:58:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 1 -- start start 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 10 monclient: init 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 10 monclient: _add_conns ranks=[0,1,4,5,7,8,6,2,3] 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 10 monclient(hunting): picked mon.noname-a con 0x7f92600a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 10 monclient(hunting): picked mon.noname-f con 0x7f9260138d40 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 10 monclient(hunting): picked mon.noname-c con 0x7f926013f350 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926013d010 con 0x7f92600a72f0 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926013a7c0 con 0x7f9260138d40 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92601428d0 con 0x7f926013f350 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f9264e65640 10 monclient(hunting): authenticate will time out at 756.691717s 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f925e59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f92600a72f0 0x7f92601399a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50490/0 (socket says 172.21.15.73:50490) 2024-09-11T01:58:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f925e59c640 1 -- 172.21.15.73:0/3296130582 learned_addr learned my addr 172.21.15.73:0/3296130582 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.087+0000 7f925ed9d640 1 --1- 172.21.15.73:0/3296130582 >> v1:172.21.15.73:6791/0 conn(0x7f926013f350 0x7f92601d5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49300/0 (socket says 172.21.15.73:49300) 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1055795936 0 0) 0x7f92601428d0 con 0x7f926013f350 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): my global_id is 4432 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9240003520 con 0x7f926013f350 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813403609 0 0) 0x7f926013d010 con 0x7f92600a72f0 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): my global_id is 4464 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92601428d0 con 0x7f92600a72f0 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254163632 0 0) 0x7f926013a7c0 con 0x7f9260138d40 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): my global_id is 4384 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f926013d010 con 0x7f9260138d40 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4187696566 0 0) 0x7f9240003520 con 0x7f926013f350 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f926013a7c0 con 0x7f926013f350 2024-09-11T01:58:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9258001910 con 0x7f926013f350 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.108 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2832491742 0 0) 0x7f92601428d0 con 0x7f92600a72f0 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9240003520 con 0x7f92600a72f0 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9250001f10 con 0x7f92600a72f0 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3447282474 0 0) 0x7f926013d010 con 0x7f9260138d40 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92601428d0 con 0x7f9260138d40 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9248004b20 con 0x7f9260138d40 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.111 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.112 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2859250434 0 0) 0x7f926013a7c0 con 0x7f926013f350 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 >> v1:172.21.15.203:6789/0 conn(0x7f9260138d40 legacy=0x7f926013a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 >> v1:172.21.15.73:6789/0 conn(0x7f92600a72f0 legacy=0x7f92601399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 monclient: found mon.c 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92600a4fa0 con 0x7f926013f350 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9264e65640 5 monclient: authenticate success, global_id 4432 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9264e65640 10 monclient: _renew_subs 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9264e65640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f926013cd30 con 0x7f926013f350 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9264e65640 10 monclient: _renew_subs 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9264e65640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f92601d6bb0 con 0x7f926013f350 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f92580035f0 con 0x7f926013f350 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9258003b60 con 0x7f926013f350 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f925cd99640 4 set_mon_vals no callback set 2024-09-11T01:58:35.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.088+0000 7f9256ffd640 10 monclient: dump: 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.115 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.089+0000 7f9264e65640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.089+0000 7f9264e65640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.089+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9258003d00 con 0x7f926013f350 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.089+0000 7f9264e65640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.089+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9244005080 con 0x7f926013f350 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.089+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7f925804df90 con 0x7f926013f350 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.090+0000 7f925e59c640 10 monclient: get_auth_request con 0x7f9240040550 auth_method 0 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.094+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f92580173c0 con 0x7f926013f350 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.094+0000 7f9256ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.094+0000 7f9256ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:35.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.338+0000 7f9264e65640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T01:58:35.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.338+0000 7f9264e65640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T01:58:35.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.338+0000 7f9264e65640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:58:35.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.338+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9244005370 con 0x7f926013f350 2024-09-11T01:58:35.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.338+0000 7f9256ffd640 1 -- 172.21.15.73:0/3296130582 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 3975222382) 0x7f9258016cc0 con 0x7f926013f350 2024-09-11T01:58:35.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.338+0000 7f9256ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T01:58:35.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.338+0000 7f9256ffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:35.341 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":8,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":26,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T01:58:35.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.340+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9240040550 legacy=0x7f9240042a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.340+0000 7f9264e65640 10 monclient: shutdown 2024-09-11T01:58:35.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.340+0000 7f9264e65640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.340+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 >> v1:172.21.15.73:6791/0 conn(0x7f926013f350 legacy=0x7f92601d5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.340+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 shutdown_connections 2024-09-11T01:58:35.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.340+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 >> 172.21.15.73:0/3296130582 conn(0x7f92600a8050 msgr2=0x7f92600a0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.340+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 shutdown_connections 2024-09-11T01:58:35.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.340+0000 7f9264e65640 1 -- 172.21.15.73:0/3296130582 wait complete. 2024-09-11T01:58:35.352 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-11T01:58:35.353 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T01:58:35.353 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-11T01:58:35.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T01:58:35.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.448+0000 7fdbbb20c640 10 monclient: get_monmap_and_config 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.448+0000 7fdbbb20c640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.449+0000 7fdbbb20c640 10 monclient: monmap: 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:35.449866+0000 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:35.449866+0000 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.452 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.452 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.452 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.452 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.452 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.452 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.449+0000 7fdbbb20c640 1 Processor -- start 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.449+0000 7fdbbb20c640 1 -- start start 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.449+0000 7fdbbb20c640 10 monclient: init 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 10 monclient: _add_conns ranks=[1,8,2,4,3,0,7,5,6] 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 10 monclient(hunting): picked mon.noname-f con 0x7fdbb4138d40 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 10 monclient(hunting): picked mon.noname-e con 0x7fdbb40a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 10 monclient(hunting): picked mon.noname-b con 0x7fdbb413f350 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb409ca00 con 0x7fdbb4138d40 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb40a7070 con 0x7fdbb413f350 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb409cee0 con 0x7fdbb40a72f0 2024-09-11T01:58:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 10 monclient(hunting): authenticate will time out at 757.054377s 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb3fff640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fdbb40a72f0 0x7fdbb413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:37212/0 (socket says 172.21.15.73:37212) 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb97a9640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fdbb413f350 0x7fdbb4141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53652/0 (socket says 172.21.15.73:53652) 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb3fff640 1 -- 172.21.15.73:0/3861675925 learned_addr learned my addr 172.21.15.73:0/3861675925 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732029190 0 0) 0x7fdbb40a7070 con 0x7fdbb413f350 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): my global_id is 4421 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb9c003520 con 0x7fdbb413f350 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214225077 0 0) 0x7fdbb409cee0 con 0x7fdbb40a72f0 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): my global_id is 4355 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb40a7070 con 0x7fdbb40a72f0 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251322268 0 0) 0x7fdbb409ca00 con 0x7fdbb4138d40 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient(hunting): my global_id is 4393 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb409cee0 con 0x7fdbb4138d40 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3941395844 0 0) 0x7fdb9c003520 con 0x7fdbb413f350 2024-09-11T01:58:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 >> v1:172.21.15.73:6793/0 conn(0x7fdbb40a72f0 legacy=0x7fdbb413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 >> v1:172.21.15.203:6789/0 conn(0x7fdbb4138d40 legacy=0x7fdbb4139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 monclient: found mon.noname-b 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb409d1c0 con 0x7fdbb413f350 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdba4001830 con 0x7fdbb413f350 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.450+0000 7fdbbb20c640 5 monclient: authenticate success, global_id 4421 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:35.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbb37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbb37fe640 10 monclient: dump: 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdba4001a50 con 0x7fdbb413f350 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbb37fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbb37fe640 1 -- 172.21.15.73:0/3861675925 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdba4004b20 con 0x7fdbb413f350 2024-09-11T01:58:35.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 4 set_mon_vals no callback set 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbb37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbb37fe640 10 monclient: dump: 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.468 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.469 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.469 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.469 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.469 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.469 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.469 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.469 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 10 monclient: shutdown 2024-09-11T01:58:35.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 1 -- 172.21.15.73:0/3861675925 >> v1:172.21.15.73:6790/0 conn(0x7fdbb413f350 legacy=0x7fdbb4141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 1 -- 172.21.15.73:0/3861675925 shutdown_connections 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 1 -- 172.21.15.73:0/3861675925 >> 172.21.15.73:0/3861675925 conn(0x7fdbb40a8050 msgr2=0x7fdbb40a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 1 -- 172.21.15.73:0/3861675925 shutdown_connections 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.451+0000 7fdbbb20c640 1 -- 172.21.15.73:0/3861675925 wait complete. 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.452+0000 7fdbbb20c640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.452+0000 7fdbbb20c640 10 monclient: monmap: 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.470 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.452+0000 7fdbbb20c640 1 Processor -- start 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.452+0000 7fdbbb20c640 1 -- start start 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.452+0000 7fdbbb20c640 10 monclient: init 2024-09-11T01:58:35.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 10 monclient: _add_conns ranks=[0,6,7,3,2,8,4,5,1] 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 10 monclient(hunting): picked mon.noname-a con 0x7fdbb40a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 10 monclient(hunting): picked mon.noname-d con 0x7fdbb4138d40 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 10 monclient(hunting): picked mon.noname-i con 0x7fdbb413f350 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb413e6a0 con 0x7fdbb40a72f0 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb409fa60 con 0x7fdbb4138d40 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbb40a06b0 con 0x7fdbb413f350 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbbb20c640 10 monclient(hunting): authenticate will time out at 757.057221s 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb8fa8640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdbb40a72f0 0x7fdbb409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50492/0 (socket says 172.21.15.73:50492) 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb8fa8640 1 -- 172.21.15.73:0/548922607 learned_addr learned my addr 172.21.15.73:0/548922607 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698778759 0 0) 0x7fdbb413e6a0 con 0x7fdbb40a72f0 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): my global_id is 4473 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdba0003520 con 0x7fdbb40a72f0 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 911782717 0 0) 0x7fdbb409fa60 con 0x7fdbb4138d40 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): my global_id is 4371 2024-09-11T01:58:35.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb413e6a0 con 0x7fdbb4138d40 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597008271 0 0) 0x7fdbb40a06b0 con 0x7fdbb413f350 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): my global_id is 4408 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb409fa60 con 0x7fdbb413f350 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 222920047 0 0) 0x7fdbb413e6a0 con 0x7fdbb4138d40 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbb40a06b0 con 0x7fdbb4138d40 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdba80013a0 con 0x7fdbb4138d40 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): dump: 2024-09-11T01:58:35.474 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.475 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.476 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:35.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4156327995 0 0) 0x7fdba0003520 con 0x7fdbb40a72f0 2024-09-11T01:58:35.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbb413e6a0 con 0x7fdbb40a72f0 2024-09-11T01:58:35.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdbac001e90 con 0x7fdbb40a72f0 2024-09-11T01:58:35.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:35.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): dump: 2024-09-11T01:58:35.478 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.478 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.478 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.478 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.478 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.478 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.479 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.479 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.479 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.479 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.479 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.479 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.480 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.480 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.480 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.480 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4136138130 0 0) 0x7fdbb409fa60 con 0x7fdbb413f350 2024-09-11T01:58:35.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdba0003520 con 0x7fdbb413f350 2024-09-11T01:58:35.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdba4001000 con 0x7fdbb413f350 2024-09-11T01:58:35.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:35.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.453+0000 7fdbb17fa640 10 monclient(hunting): dump: 2024-09-11T01:58:35.481 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.481 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.481 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1913017785 0 0) 0x7fdbb40a06b0 con 0x7fdbb4138d40 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 >> v1:172.21.15.203:6792/0 conn(0x7fdbb413f350 legacy=0x7fdbb41d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 >> v1:172.21.15.73:6789/0 conn(0x7fdbb40a72f0 legacy=0x7fdbb409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 1 monclient: found mon.d 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb4142150 con 0x7fdbb4138d40 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbbb20c640 5 monclient: authenticate success, global_id 4371 2024-09-11T01:58:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbbb20c640 10 monclient: _renew_subs 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbbb20c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb40a1710 con 0x7fdbb4138d40 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbbb20c640 10 monclient: _renew_subs 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbbb20c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fdbb413e9e0 con 0x7fdbb4138d40 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdba80016e0 con 0x7fdbb4138d40 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdba8004dd0 con 0x7fdbb4138d40 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb2ffd640 4 set_mon_vals no callback set 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 10 monclient: dump: 2024-09-11T01:58:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbbb20c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdb940065c0 con 0x7fdb94002860 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.454+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fdba8011510 con 0x7fdbb4138d40 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7fdba804e200 con 0x7fdbb4138d40 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481980635 0 0) 0x7fdb940065c0 con 0x7fdb94002860 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 10 monclient(hunting): my global_id is 4482 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb40a06b0 con 0x7fdb94002860 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb97a9640 10 monclient: get_auth_request con 0x7fdba00405e0 auth_method 0 2024-09-11T01:58:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1870427036 0 0) 0x7fdbb40a06b0 con 0x7fdb94002860 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb940065c0 con 0x7fdb94002860 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdbac0020c0 con 0x7fdb94002860 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 10 monclient: dump: 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 864138762 0 0) 0x7fdb940065c0 con 0x7fdb94002860 2024-09-11T01:58:35.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.455+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb9400a160 con 0x7fdb94002860 2024-09-11T01:58:35.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.456+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdbac005b40 con 0x7fdb94002860 2024-09-11T01:58:35.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.456+0000 7fdbb17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.456+0000 7fdbb17fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:35.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.456+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 >> v1:172.21.15.73:6789/0 conn(0x7fdb94002860 legacy=0x7fdb94004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.456+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 >> v1:172.21.15.73:6789/0 conn(0x7fdb94002860 legacy=0x7fdb94004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbbb20c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdb94009e00 con 0x7fdb940090e0 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982959109 0 0) 0x7fdb94009e00 con 0x7fdb940090e0 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 10 monclient(hunting): my global_id is 4491 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb940065c0 con 0x7fdb940090e0 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2376461210 0 0) 0x7fdb940065c0 con 0x7fdb940090e0 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb94009e00 con 0x7fdb940090e0 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdbac004720 con 0x7fdb940090e0 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 10 monclient: dump: 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2196662081 0 0) 0x7fdb94009e00 con 0x7fdb940090e0 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 --> v1:172.21.15.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdb9400c3a0 con 0x7fdb940090e0 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7712 (unknown 0 0 3766059402) 0x7fdbac006030 con 0x7fdb940090e0 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 >> v1:172.21.15.73:6789/0 conn(0x7fdb940090e0 legacy=0x7fdb94009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.462+0000 7fdbb17fa640 1 -- 172.21.15.73:0/548922607 >> v1:172.21.15.73:6789/0 conn(0x7fdb940090e0 legacy=0x7fdb94009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:35.494 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:58:35.494 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:35.494 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:35.494 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-09-11T01:58:35.494 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 8, 2024-09-11T01:58:35.494 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 37902, 2024-09-11T01:58:35.494 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:58:35.494 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 26, 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:58:35.495 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.496 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.497 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:35.498 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.500 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.501 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.502 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.504 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.505 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:35.506 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:58:35.507 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:58:35.508 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.508 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.508 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.508 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.508 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.508 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:35.508 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:35.508 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.508 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.509 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.510 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.511 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:35.512 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.513 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T01:58:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.516 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:58:35.516 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:58:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 >> v1:172.21.15.203:6812/2311533528 conn(0x7fdba00405e0 legacy=0x7fdba0042aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbbb20c640 10 monclient: shutdown 2024-09-11T01:58:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbbb20c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 >> v1:172.21.15.73:6792/0 conn(0x7fdbb4138d40 legacy=0x7fdbb409f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbb97a9640 1 -- 172.21.15.73:0/548922607 reap_dead start 2024-09-11T01:58:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbb97a9640 1 -- 172.21.15.73:0/548922607 reap_dead start 2024-09-11T01:58:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 shutdown_connections 2024-09-11T01:58:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 >> 172.21.15.73:0/548922607 conn(0x7fdbb40a8050 msgr2=0x7fdbb40a96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 shutdown_connections 2024-09-11T01:58:35.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.463+0000 7fdbbb20c640 1 -- 172.21.15.73:0/548922607 wait complete. 2024-09-11T01:58:35.518 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T01:58:35.518 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-11T01:58:35.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T01:58:35.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.617+0000 7f52ce19b640 10 monclient: get_monmap_and_config 2024-09-11T01:58:35.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.617+0000 7f52ce19b640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.617+0000 7f52ce19b640 10 monclient: monmap: 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:35.618090+0000 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:35.618090+0000 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.620 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.620 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.620 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.620 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.617+0000 7f52ce19b640 1 Processor -- start 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 1 -- start start 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 10 monclient: init 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 10 monclient: _add_conns ranks=[5,6,2,4,7,8,3,0,1] 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 10 monclient(hunting): picked mon.noname-h con 0x7f52c8138d40 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 10 monclient(hunting): picked mon.noname-d con 0x7f52c80a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 10 monclient(hunting): picked mon.noname-b con 0x7f52c813f350 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c809ca00 con 0x7f52c813f350 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c80a7070 con 0x7f52c8138d40 2024-09-11T01:58:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c809cee0 con 0x7f52c80a72f0 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52ce19b640 10 monclient(hunting): authenticate will time out at 757.222548s 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c7fff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f52c813f350 0x7f52c8141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53668/0 (socket says 172.21.15.73:53668) 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c7fff640 1 -- 172.21.15.73:0/3380161688 learned_addr learned my addr 172.21.15.73:0/3380161688 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52beffd640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f52c80a72f0 0x7f52c813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:35138/0 (socket says 172.21.15.73:35138) 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082115723 0 0) 0x7f52c809cee0 con 0x7f52c80a72f0 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 10 monclient(hunting): my global_id is 4380 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52b4003520 con 0x7f52c80a72f0 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840555509 0 0) 0x7f52c809ca00 con 0x7f52c813f350 2024-09-11T01:58:35.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 10 monclient(hunting): my global_id is 4430 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.618+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c809cee0 con 0x7f52c813f350 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314287921 0 0) 0x7f52c80a7070 con 0x7f52c8138d40 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient(hunting): my global_id is 4451 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c809ca00 con 0x7f52c8138d40 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3293102356 0 0) 0x7f52b4003520 con 0x7f52c80a72f0 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 >> v1:172.21.15.203:6791/0 conn(0x7f52c8138d40 legacy=0x7f52c8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 >> v1:172.21.15.73:6790/0 conn(0x7f52c813f350 legacy=0x7f52c8141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 monclient: found mon.noname-d 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c809d1c0 con 0x7f52c80a72f0 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f52b0001830 con 0x7f52c80a72f0 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 5 monclient: authenticate success, global_id 4380 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: dump: 2024-09-11T01:58:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.633 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52b0001a50 con 0x7f52c80a72f0 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 1 -- 172.21.15.73:0/3380161688 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f52b0004b20 con 0x7f52c80a72f0 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 4 set_mon_vals no callback set 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52c6ffd640 10 monclient: dump: 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 10 monclient: shutdown 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 1 -- 172.21.15.73:0/3380161688 >> v1:172.21.15.73:6792/0 conn(0x7f52c80a72f0 legacy=0x7f52c813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 1 -- 172.21.15.73:0/3380161688 shutdown_connections 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 1 -- 172.21.15.73:0/3380161688 >> 172.21.15.73:0/3380161688 conn(0x7f52c80a8050 msgr2=0x7f52c80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 1 -- 172.21.15.73:0/3380161688 shutdown_connections 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.619+0000 7f52ce19b640 1 -- 172.21.15.73:0/3380161688 wait complete. 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.620+0000 7f52ce19b640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.620+0000 7f52ce19b640 10 monclient: monmap: 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.636 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.620+0000 7f52ce19b640 1 Processor -- start 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.620+0000 7f52ce19b640 1 -- start start 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.620+0000 7f52ce19b640 10 monclient: init 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 10 monclient: _add_conns ranks=[3,5,0,1,4,8,7,6,2] 2024-09-11T01:58:35.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 10 monclient(hunting): picked mon.noname-g con 0x7f52c80a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 10 monclient(hunting): picked mon.noname-h con 0x7f52c8138d40 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 10 monclient(hunting): picked mon.noname-a con 0x7f52c813f350 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c813a800 con 0x7f52c813f350 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c80a2320 con 0x7f52c80a72f0 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c813ab60 con 0x7f52c8138d40 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52ce19b640 10 monclient(hunting): authenticate will time out at 757.225357s 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c7fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f52c813f350 0x7f52c81d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50512/0 (socket says 172.21.15.73:50512) 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c7fff640 1 -- 172.21.15.73:0/2813474356 learned_addr learned my addr 172.21.15.73:0/2813474356 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 389423864 0 0) 0x7f52c813a800 con 0x7f52c813f350 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): my global_id is 4500 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52a8003520 con 0x7f52c813f350 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7678741 0 0) 0x7f52c813ab60 con 0x7f52c8138d40 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): my global_id is 4460 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c813a800 con 0x7f52c8138d40 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596593902 0 0) 0x7f52c80a2320 con 0x7f52c80a72f0 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): my global_id is 4485 2024-09-11T01:58:35.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c813ab60 con 0x7f52c80a72f0 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2842054574 0 0) 0x7f52a8003520 con 0x7f52c813f350 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52c80a2320 con 0x7f52c813f350 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f52c0001740 con 0x7f52c813f350 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.640 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.621+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4252326556 0 0) 0x7f52c813a800 con 0x7f52c8138d40 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52a8003520 con 0x7f52c8138d40 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f52b00017f0 con 0x7f52c8138d40 2024-09-11T01:58:35.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.642 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 630816555 0 0) 0x7f52c80a2320 con 0x7f52c813f350 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 >> v1:172.21.15.203:6791/0 conn(0x7f52c8138d40 legacy=0x7f52c813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 >> v1:172.21.15.203:6790/0 conn(0x7f52c80a72f0 legacy=0x7f52c81399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 1 monclient: found mon.a 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c813cec0 con 0x7f52c813f350 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52ce19b640 5 monclient: authenticate success, global_id 4500 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52ce19b640 10 monclient: _renew_subs 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52ce19b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f52c813c620 con 0x7f52c813f350 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52ce19b640 10 monclient: _renew_subs 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52ce19b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f52c813b930 con 0x7f52c813f350 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52c0001a60 con 0x7f52c813f350 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f52c0005150 con 0x7f52c813f350 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:35.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c67fc640 4 set_mon_vals no callback set 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52c4ff9640 10 monclient: dump: 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.645 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52ce19b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.622+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f52ac0065c0 con 0x7f52ac002860 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f52c0011890 con 0x7f52c813f350 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7f52c004e4b0 con 0x7f52c813f350 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728613758 0 0) 0x7f52ac0065c0 con 0x7f52ac002860 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 10 monclient(hunting): my global_id is 4439 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c80a2320 con 0x7f52ac002860 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52beffd640 10 monclient: get_auth_request con 0x7f52a8040420 auth_method 0 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2086345755 0 0) 0x7f52c80a2320 con 0x7f52ac002860 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52ac0065c0 con 0x7f52ac002860 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f52b80018f0 con 0x7f52ac002860 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 10 monclient: dump: 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.647 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3277925205 0 0) 0x7f52ac0065c0 con 0x7f52ac002860 2024-09-11T01:58:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.623+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52ac00a160 con 0x7f52ac002860 2024-09-11T01:58:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.624+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f52b8001cc0 con 0x7f52ac002860 2024-09-11T01:58:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.624+0000 7f52c4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.624+0000 7f52c4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.624+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 >> v1:172.21.15.73:6790/0 conn(0x7f52ac002860 legacy=0x7f52ac004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.624+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 >> v1:172.21.15.73:6790/0 conn(0x7f52ac002860 legacy=0x7f52ac004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:35.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52ce19b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:58:35.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f52ac009e00 con 0x7f52ac0090e0 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820667473 0 0) 0x7f52ac009e00 con 0x7f52ac0090e0 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 10 monclient(hunting): my global_id is 4448 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52ac0065c0 con 0x7f52ac0090e0 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4105475914 0 0) 0x7f52ac0065c0 con 0x7f52ac0090e0 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52ac009e00 con 0x7f52ac0090e0 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f52b8003c00 con 0x7f52ac0090e0 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 10 monclient: dump: 2024-09-11T01:58:35.651 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.652 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1801398179 0 0) 0x7f52ac009e00 con 0x7f52ac0090e0 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 --> v1:172.21.15.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f52ac00c3a0 con 0x7f52ac0090e0 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7710 (unknown 0 0 3988513589) 0x7f52b80050f0 con 0x7f52ac0090e0 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 >> v1:172.21.15.73:6790/0 conn(0x7f52ac0090e0 legacy=0x7f52ac009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.630+0000 7f52c4ff9640 1 -- 172.21.15.73:0/2813474356 >> v1:172.21.15.73:6790/0 conn(0x7f52ac0090e0 legacy=0x7f52ac009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:58:35.653 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 8, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 38088, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T01:58:35.654 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 27, 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.655 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.656 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:35.657 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.658 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.659 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:58:35.661 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.662 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:58:35.665 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.667 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:35.668 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.669 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:58:35.670 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.671 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.672 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.673 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:58:35.673 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:58:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 >> v1:172.21.15.203:6812/2311533528 conn(0x7f52a8040420 legacy=0x7f52a80428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52ce19b640 10 monclient: shutdown 2024-09-11T01:58:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52ce19b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 >> v1:172.21.15.73:6789/0 conn(0x7f52c813f350 legacy=0x7f52c81d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52c7fff640 1 -- 172.21.15.73:0/2813474356 reap_dead start 2024-09-11T01:58:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52c7fff640 1 -- 172.21.15.73:0/2813474356 reap_dead start 2024-09-11T01:58:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 shutdown_connections 2024-09-11T01:58:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 >> 172.21.15.73:0/2813474356 conn(0x7f52c80a8050 msgr2=0x7f52c80a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 shutdown_connections 2024-09-11T01:58:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.631+0000 7f52ce19b640 1 -- 172.21.15.73:0/2813474356 wait complete. 2024-09-11T01:58:35.675 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T01:58:35.675 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-11T01:58:35.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.772+0000 7f3f7653d640 10 monclient: get_monmap_and_config 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.772+0000 7f3f7653d640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.772+0000 7f3f7653d640 10 monclient: monmap: 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:35.773388+0000 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:35.773388+0000 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.774 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.775 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.775 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.775 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.775 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.775 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.775 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.775 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.775 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 1 Processor -- start 2024-09-11T01:58:35.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 1 -- start start 2024-09-11T01:58:35.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 10 monclient: init 2024-09-11T01:58:35.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 10 monclient: _add_conns ranks=[2,7,3,1,8,6,5,4,0] 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 10 monclient(hunting): picked mon.noname-b con 0x7f3f70138d40 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 10 monclient(hunting): picked mon.noname-i con 0x7f3f700a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 10 monclient(hunting): picked mon.noname-g con 0x7f3f7013f350 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7009ca00 con 0x7f3f70138d40 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f700a7070 con 0x7f3f7013f350 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7009cee0 con 0x7f3f700a72f0 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f7653d640 10 monclient(hunting): authenticate will time out at 757.377836s 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f6ffff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f3f70138d40 0x7f3f70139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53692/0 (socket says 172.21.15.73:53692) 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.773+0000 7f3f6ffff640 1 -- 172.21.15.73:0/2831788516 learned_addr learned my addr 172.21.15.73:0/2831788516 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 -- 172.21.15.73:0/2831788516 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1685180581 0 0) 0x7f3f7009ca00 con 0x7f3f70138d40 2024-09-11T01:58:35.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient(hunting): my global_id is 4457 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 -- 172.21.15.73:0/2831788516 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f58003520 con 0x7f3f70138d40 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 -- 172.21.15.73:0/2831788516 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4064790595 0 0) 0x7f3f58003520 con 0x7f3f70138d40 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 -- 172.21.15.73:0/2831788516 >> v1:172.21.15.203:6792/0 conn(0x7f3f700a72f0 legacy=0x7f3f7013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 -- 172.21.15.73:0/2831788516 >> v1:172.21.15.203:6790/0 conn(0x7f3f7013f350 legacy=0x7f3f70141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 monclient: found mon.noname-b 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 -- 172.21.15.73:0/2831788516 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7009d1c0 con 0x7f3f70138d40 2024-09-11T01:58:35.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 -- 172.21.15.73:0/2831788516 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f60001850 con 0x7f3f70138d40 2024-09-11T01:58:35.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:35.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: dump: 2024-09-11T01:58:35.787 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.787 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.787 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.788 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f7653d640 5 monclient: authenticate success, global_id 4457 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f7653d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 -- 172.21.15.73:0/2831788516 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f60001a70 con 0x7f3f70138d40 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 1 -- 172.21.15.73:0/2831788516 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f60004be0 con 0x7f3f70138d40 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f6effd640 10 monclient: dump: 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.789 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f7653d640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f7653d640 4 set_mon_vals no callback set 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f7653d640 10 monclient: shutdown 2024-09-11T01:58:35.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f7653d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.774+0000 7f3f7653d640 1 -- 172.21.15.73:0/2831788516 >> v1:172.21.15.73:6790/0 conn(0x7f3f70138d40 legacy=0x7f3f70139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.775+0000 7f3f7653d640 1 -- 172.21.15.73:0/2831788516 shutdown_connections 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.775+0000 7f3f7653d640 1 -- 172.21.15.73:0/2831788516 >> 172.21.15.73:0/2831788516 conn(0x7f3f700a8050 msgr2=0x7f3f700a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.775+0000 7f3f7653d640 1 -- 172.21.15.73:0/2831788516 shutdown_connections 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.775+0000 7f3f7653d640 1 -- 172.21.15.73:0/2831788516 wait complete. 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.775+0000 7f3f7653d640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.775+0000 7f3f7653d640 10 monclient: monmap: 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:35.791 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:35.792 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:35.792 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.792 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:35.792 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.792 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.792 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.792 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.792 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.792 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.775+0000 7f3f7653d640 1 Processor -- start 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 1 -- start start 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 10 monclient: init 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 10 monclient: _add_conns ranks=[0,3,2,5,1,6,4,7,8] 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 10 monclient(hunting): picked mon.noname-a con 0x7f3f700a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:35.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 10 monclient(hunting): picked mon.noname-g con 0x7f3f70138d40 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 10 monclient(hunting): picked mon.noname-b con 0x7f3f7013f350 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f701413e0 con 0x7f3f700a72f0 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f701409d0 con 0x7f3f7013f350 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7013a320 con 0x7f3f70138d40 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f7653d640 10 monclient(hunting): authenticate will time out at 757.380536s 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3f700a72f0 0x7f3f7013fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50524/0 (socket says 172.21.15.73:50524) 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6ffff640 1 -- 172.21.15.73:0/3717590020 learned_addr learned my addr 172.21.15.73:0/3717590020 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526609165 0 0) 0x7f3f701413e0 con 0x7f3f700a72f0 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): my global_id is 4509 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f5c003520 con 0x7f3f700a72f0 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10002265 0 0) 0x7f3f701409d0 con 0x7f3f7013f350 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): my global_id is 4466 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f701413e0 con 0x7f3f7013f350 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446452392 0 0) 0x7f3f7013a320 con 0x7f3f70138d40 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 10 monclient(hunting): my global_id is 4503 2024-09-11T01:58:35.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.776+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f701409d0 con 0x7f3f70138d40 2024-09-11T01:58:35.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 945400249 0 0) 0x7f3f5c003520 con 0x7f3f700a72f0 2024-09-11T01:58:35.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f7013a320 con 0x7f3f700a72f0 2024-09-11T01:58:35.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f60004b20 con 0x7f3f700a72f0 2024-09-11T01:58:35.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:35.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): dump: 2024-09-11T01:58:35.797 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.797 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.797 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.797 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.797 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.797 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2933449900 0 0) 0x7f3f701413e0 con 0x7f3f7013f350 2024-09-11T01:58:35.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f5c003520 con 0x7f3f7013f350 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f68001be0 con 0x7f3f7013f350 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): dump: 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.799 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1908732610 0 0) 0x7f3f701409d0 con 0x7f3f70138d40 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f701413e0 con 0x7f3f70138d40 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f640019d0 con 0x7f3f70138d40 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:35.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient(hunting): dump: 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.801 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1971086551 0 0) 0x7f3f7013a320 con 0x7f3f700a72f0 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 >> v1:172.21.15.203:6790/0 conn(0x7f3f70138d40 legacy=0x7f3f701402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 >> v1:172.21.15.73:6790/0 conn(0x7f3f7013f350 legacy=0x7f3f701d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 monclient: found mon.a 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7013a600 con 0x7f3f700a72f0 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f7653d640 5 monclient: authenticate success, global_id 4509 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f7653d640 10 monclient: _renew_subs 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f7653d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7013a8e0 con 0x7f3f700a72f0 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f7653d640 10 monclient: _renew_subs 2024-09-11T01:58:35.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f7653d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3f70138450 con 0x7f3f700a72f0 2024-09-11T01:58:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f600011b0 con 0x7f3f700a72f0 2024-09-11T01:58:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f60001930 con 0x7f3f700a72f0 2024-09-11T01:58:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6e7fc640 4 set_mon_vals no callback set 2024-09-11T01:58:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.777+0000 7f3f6cff9640 10 monclient: dump: 2024-09-11T01:58:35.804 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.805 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f7653d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3f500065c0 con 0x7f3f50002860 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f3f60011780 con 0x7f3f700a72f0 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7f3f6004e320 con 0x7f3f700a72f0 2024-09-11T01:58:35.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418753951 0 0) 0x7f3f500065c0 con 0x7f3f50002860 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 10 monclient(hunting): my global_id is 4441 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f7013a320 con 0x7f3f50002860 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f74ada640 10 monclient: get_auth_request con 0x7f3f5c0406e0 auth_method 0 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1583659705 0 0) 0x7f3f7013a320 con 0x7f3f50002860 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f500065c0 con 0x7f3f50002860 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f64003930 con 0x7f3f50002860 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:35.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 10 monclient: dump: 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.808 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.809 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1175064166 0 0) 0x7f3f500065c0 con 0x7f3f50002860 2024-09-11T01:58:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.778+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f5000a160 con 0x7f3f50002860 2024-09-11T01:58:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.779+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3f64005b90 con 0x7f3f50002860 2024-09-11T01:58:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.779+0000 7f3f6cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.779+0000 7f3f6cff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.779+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 >> v1:172.21.15.73:6791/0 conn(0x7f3f50002860 legacy=0x7f3f50004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.779+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 >> v1:172.21.15.73:6791/0 conn(0x7f3f50002860 legacy=0x7f3f50004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f7653d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3f50009e70 con 0x7f3f50009130 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815527886 0 0) 0x7f3f50009e70 con 0x7f3f50009130 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 10 monclient(hunting): my global_id is 4450 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f500065c0 con 0x7f3f50009130 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 305252183 0 0) 0x7f3f500065c0 con 0x7f3f50009130 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f50009e70 con 0x7f3f50009130 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f640054c0 con 0x7f3f50009130 2024-09-11T01:58:35.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.785+0000 7f3f6cff9640 10 monclient: dump: 2024-09-11T01:58:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.812 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 762473122 0 0) 0x7f3f50009e70 con 0x7f3f50009130 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 --> v1:172.21.15.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f5000c3f0 con 0x7f3f50009130 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 1129325376) 0x7f3f64005720 con 0x7f3f50009130 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f6cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f6cff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 >> v1:172.21.15.73:6791/0 conn(0x7f3f50009130 legacy=0x7f3f500095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f6cff9640 1 -- 172.21.15.73:0/3717590020 >> v1:172.21.15.73:6791/0 conn(0x7f3f50009130 legacy=0x7f3f500095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:58:35.814 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 8, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 38249, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 27, 2024-09-11T01:58:35.815 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.816 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.817 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.818 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:58:35.819 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.820 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.822 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.823 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:58:35.824 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.825 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:58:35.827 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:58:35.828 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.829 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:58:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.832 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.833 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:58:35.834 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 >> v1:172.21.15.203:6812/2311533528 conn(0x7f3f5c0406e0 legacy=0x7f3f5c042ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f7653d640 10 monclient: shutdown 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f7653d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 >> v1:172.21.15.73:6789/0 conn(0x7f3f700a72f0 legacy=0x7f3f7013fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f74ada640 1 -- 172.21.15.73:0/3717590020 reap_dead start 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f74ada640 1 -- 172.21.15.73:0/3717590020 reap_dead start 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 shutdown_connections 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 >> 172.21.15.73:0/3717590020 conn(0x7f3f700a8050 msgr2=0x7f3f701308e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 shutdown_connections 2024-09-11T01:58:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.786+0000 7f3f7653d640 1 -- 172.21.15.73:0/3717590020 wait complete. 2024-09-11T01:58:35.837 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T01:58:35.837 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-11T01:58:35.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-11T01:58:35.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.934+0000 7fd23b085640 10 monclient: get_monmap_and_config 2024-09-11T01:58:35.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.934+0000 7fd23b085640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.934+0000 7fd23b085640 10 monclient: monmap: 2024-09-11T01:58:35.936 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.936 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.936 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:35.935637+0000 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:35.935637+0000 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.937 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.935+0000 7fd23b085640 1 Processor -- start 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.935+0000 7fd23b085640 1 -- start start 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.935+0000 7fd23b085640 10 monclient: init 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 10 monclient: _add_conns ranks=[6,0,1,5,2,4,8,7,3] 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 10 monclient(hunting): picked mon.noname-d con 0x7fd234138d40 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 10 monclient(hunting): picked mon.noname-a con 0x7fd2340a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 10 monclient(hunting): picked mon.noname-f con 0x7fd23413f350 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23409ca00 con 0x7fd2340a72f0 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2340a7070 con 0x7fd23413f350 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23409cee0 con 0x7fd234138d40 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 10 monclient(hunting): authenticate will time out at 757.540135s 2024-09-11T01:58:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd2340a72f0 0x7fd23413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50526/0 (socket says 172.21.15.73:50526) 2024-09-11T01:58:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd238e21640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fd234138d40 0x7fd234139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:35148/0 (socket says 172.21.15.73:35148) 2024-09-11T01:58:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22bfff640 1 -- 172.21.15.73:0/995793660 learned_addr learned my addr 172.21.15.73:0/995793660 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228304540 0 0) 0x7fd23409ca00 con 0x7fd2340a72f0 2024-09-11T01:58:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): my global_id is 4518 2024-09-11T01:58:35.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd21c003520 con 0x7fd2340a72f0 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984511174 0 0) 0x7fd23409cee0 con 0x7fd234138d40 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): my global_id is 4389 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd23409ca00 con 0x7fd234138d40 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500841333 0 0) 0x7fd2340a7070 con 0x7fd23413f350 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient(hunting): my global_id is 4402 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd23409cee0 con 0x7fd23413f350 2024-09-11T01:58:35.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 353596186 0 0) 0x7fd21c003520 con 0x7fd2340a72f0 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 >> v1:172.21.15.73:6792/0 conn(0x7fd234138d40 legacy=0x7fd234139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 >> v1:172.21.15.203:6789/0 conn(0x7fd23413f350 legacy=0x7fd234141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 monclient: found mon.noname-a 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23409d1c0 con 0x7fd2340a72f0 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 5 monclient: authenticate success, global_id 4518 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd224001850 con 0x7fd2340a72f0 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: dump: 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2240019f0 con 0x7fd2340a72f0 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 1 -- 172.21.15.73:0/995793660 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd224004be0 con 0x7fd2340a72f0 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd23b085640 4 set_mon_vals no callback set 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.936+0000 7fd22b7fe640 10 monclient: dump: 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.952 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.937+0000 7fd23b085640 10 monclient: shutdown 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.937+0000 7fd23b085640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.937+0000 7fd23b085640 1 -- 172.21.15.73:0/995793660 >> v1:172.21.15.73:6789/0 conn(0x7fd2340a72f0 legacy=0x7fd23413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.937+0000 7fd23b085640 1 -- 172.21.15.73:0/995793660 shutdown_connections 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.937+0000 7fd23b085640 1 -- 172.21.15.73:0/995793660 >> 172.21.15.73:0/995793660 conn(0x7fd2340a8050 msgr2=0x7fd2340a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.937+0000 7fd23b085640 1 -- 172.21.15.73:0/995793660 shutdown_connections 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.937+0000 7fd23b085640 1 -- 172.21.15.73:0/995793660 wait complete. 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.937+0000 7fd23b085640 10 monclient: build_initial_monmap 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.937+0000 7fd23b085640 10 monclient: monmap: 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 1 Processor -- start 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 1 -- start start 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 10 monclient: init 2024-09-11T01:58:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 10 monclient: _add_conns ranks=[5,0,1,4,7,8,3,6,2] 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 10 monclient(hunting): picked mon.noname-h con 0x7fd2340a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 10 monclient(hunting): picked mon.noname-a con 0x7fd234138d40 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 10 monclient(hunting): picked mon.noname-f con 0x7fd23413f350 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23413c500 con 0x7fd234138d40 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23413c7e0 con 0x7fd23413f350 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd23413cac0 con 0x7fd2340a72f0 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd23b085640 10 monclient(hunting): authenticate will time out at 757.542892s 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd22bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd234138d40 0x7fd2341d1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50532/0 (socket says 172.21.15.73:50532) 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.938+0000 7fd22bfff640 1 -- 172.21.15.73:0/1008091656 learned_addr learned my addr 172.21.15.73:0/1008091656 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638550368 0 0) 0x7fd23413c500 con 0x7fd234138d40 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): my global_id is 4527 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd220003520 con 0x7fd234138d40 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 866598994 0 0) 0x7fd220003520 con 0x7fd234138d40 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd23413c500 con 0x7fd234138d40 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd2240017f0 con 0x7fd234138d40 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): dump: 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319157140 0 0) 0x7fd23413c7e0 con 0x7fd23413f350 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): my global_id is 4411 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd220003520 con 0x7fd23413f350 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 614269825 0 0) 0x7fd23413cac0 con 0x7fd2340a72f0 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient(hunting): my global_id is 4469 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd23413c7e0 con 0x7fd2340a72f0 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 633466505 0 0) 0x7fd23413c500 con 0x7fd234138d40 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 >> v1:172.21.15.203:6791/0 conn(0x7fd2340a72f0 legacy=0x7fd23413e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 >> v1:172.21.15.203:6789/0 conn(0x7fd23413f350 legacy=0x7fd2341d54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 monclient: found mon.a 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23413cda0 con 0x7fd234138d40 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd23b085640 5 monclient: authenticate success, global_id 4527 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd23b085640 10 monclient: _renew_subs 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd23b085640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd23413b870 con 0x7fd234138d40 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd23b085640 10 monclient: _renew_subs 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd23b085640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd2341d6da0 con 0x7fd234138d40 2024-09-11T01:58:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd224001210 con 0x7fd234138d40 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd224004c30 con 0x7fd234138d40 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd22affd640 4 set_mon_vals no callback set 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.939+0000 7fd2297fa640 10 monclient: dump: 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd23b085640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd2140065c0 con 0x7fd214002860 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fd2240117c0 con 0x7fd234138d40 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 699450353 0 0) 0x7fd22404e2d0 con 0x7fd234138d40 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078745858 0 0) 0x7fd2140065c0 con 0x7fd214002860 2024-09-11T01:58:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd2297fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd2297fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd2297fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd2297fa640 10 monclient(hunting): my global_id is 4398 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd23413c500 con 0x7fd214002860 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.940+0000 7fd239622640 10 monclient: get_auth_request con 0x7fd22003fea0 auth_method 0 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 724824841 0 0) 0x7fd23413c500 con 0x7fd214002860 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2140065c0 con 0x7fd214002860 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd230001890 con 0x7fd214002860 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 10 monclient: dump: 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 862194929 0 0) 0x7fd2140065c0 con 0x7fd214002860 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd21400a160 con 0x7fd214002860 2024-09-11T01:58:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd230001be0 con 0x7fd214002860 2024-09-11T01:58:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 >> v1:172.21.15.73:6792/0 conn(0x7fd214002860 legacy=0x7fd214004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.941+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 >> v1:172.21.15.73:6792/0 conn(0x7fd214002860 legacy=0x7fd214004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:35.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.947+0000 7fd23b085640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:58:35.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.947+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd214009e00 con 0x7fd2140090e0 2024-09-11T01:58:35.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.947+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4007445136 0 0) 0x7fd214009e00 con 0x7fd2140090e0 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.947+0000 7fd2297fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.947+0000 7fd2297fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.947+0000 7fd2297fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.947+0000 7fd2297fa640 10 monclient(hunting): my global_id is 4407 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.947+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2140065c0 con 0x7fd2140090e0 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.947+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2771936277 0 0) 0x7fd2140065c0 con 0x7fd2140090e0 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd214009e00 con 0x7fd2140090e0 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd230004d10 con 0x7fd2140090e0 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 10 monclient: dump: 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:35.966 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2778504769 0 0) 0x7fd214009e00 con 0x7fd2140090e0 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 --> v1:172.21.15.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd21400c3a0 con 0x7fd2140090e0 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2256798163) 0x7fd2300061a0 con 0x7fd2140090e0 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 >> v1:172.21.15.73:6792/0 conn(0x7fd2140090e0 legacy=0x7fd214009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd2297fa640 1 -- 172.21.15.73:0/1008091656 >> v1:172.21.15.73:6792/0 conn(0x7fd2140090e0 legacy=0x7fd214009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:35.968 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 8, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 38396, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.969 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 27, 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.970 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.971 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:58:35.972 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:35.973 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:35.975 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.976 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:58:35.978 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.979 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.981 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:58:35.983 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:35.984 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.985 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:35.986 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:35.987 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:35.987 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:35.987 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:58:35.987 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:58:35.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 >> v1:172.21.15.203:6812/2311533528 conn(0x7fd22003fea0 legacy=0x7fd220042360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd23b085640 10 monclient: shutdown 2024-09-11T01:58:35.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd23b085640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:35.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 >> v1:172.21.15.73:6789/0 conn(0x7fd234138d40 legacy=0x7fd2341d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:35.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd239622640 1 -- 172.21.15.73:0/1008091656 reap_dead start 2024-09-11T01:58:35.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd239622640 1 -- 172.21.15.73:0/1008091656 reap_dead start 2024-09-11T01:58:35.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 shutdown_connections 2024-09-11T01:58:35.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 >> 172.21.15.73:0/1008091656 conn(0x7fd2340a8050 msgr2=0x7fd2340a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:35.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 shutdown_connections 2024-09-11T01:58:35.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:35.948+0000 7fd23b085640 1 -- 172.21.15.73:0/1008091656 wait complete. 2024-09-11T01:58:35.989 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T01:58:35.989 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-11T01:58:35.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-11T01:58:36.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.091+0000 7f7ffdbf3640 10 monclient: get_monmap_and_config 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.091+0000 7f7ffdbf3640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.091+0000 7f7ffdbf3640 10 monclient: monmap: 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:36.092075+0000 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:36.092075+0000 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.093 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.094 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.094 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.094 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.094 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.094 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.094 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.091+0000 7f7ffdbf3640 1 Processor -- start 2024-09-11T01:58:36.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 1 -- start start 2024-09-11T01:58:36.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 10 monclient: init 2024-09-11T01:58:36.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 10 monclient: _add_conns ranks=[0,2,3,7,8,4,6,5,1] 2024-09-11T01:58:36.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 10 monclient(hunting): picked mon.noname-a con 0x7f7ff8138d40 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:36.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 10 monclient(hunting): picked mon.noname-b con 0x7f7ff80a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 10 monclient(hunting): picked mon.noname-g con 0x7f7ff813f350 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff809ca00 con 0x7f7ff8138d40 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff80a7070 con 0x7f7ff80a72f0 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff809cee0 con 0x7f7ff813f350 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ffdbf3640 10 monclient(hunting): authenticate will time out at 757.696514s 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff6ffd640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f7ff80a72f0 0x7f7ff813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53712/0 (socket says 172.21.15.73:53712) 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff6ffd640 1 -- 172.21.15.73:0/615976239 learned_addr learned my addr 172.21.15.73:0/615976239 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff77fe640 1 --1- 172.21.15.73:0/615976239 >> v1:172.21.15.73:6789/0 conn(0x7f7ff8138d40 0x7f7ff8139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50544/0 (socket says 172.21.15.73:50544) 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305810797 0 0) 0x7f7ff80a7070 con 0x7f7ff80a72f0 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 10 monclient(hunting): my global_id is 4475 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe4003520 con 0x7f7ff80a72f0 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 69727556 0 0) 0x7f7ff809ca00 con 0x7f7ff8138d40 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 10 monclient(hunting): my global_id is 4536 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.092+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff80a7070 con 0x7f7ff8138d40 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2995025887 0 0) 0x7f7fe4003520 con 0x7f7ff80a72f0 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 >> v1:172.21.15.203:6790/0 conn(0x7f7ff813f350 legacy=0x7f7ff8141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 >> v1:172.21.15.73:6789/0 conn(0x7f7ff8138d40 legacy=0x7f7ff8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 1 monclient: found mon.noname-b 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff809d1c0 con 0x7f7ff80a72f0 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 5 monclient: authenticate success, global_id 4475 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7fe8001830 con 0x7f7ff80a72f0 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: dump: 2024-09-11T01:58:36.106 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.107 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fe8001a50 con 0x7f7ff80a72f0 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 1 -- 172.21.15.73:0/615976239 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7fe8004be0 con 0x7f7ff80a72f0 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 4 set_mon_vals no callback set 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ff67fc640 10 monclient: dump: 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 10 monclient: shutdown 2024-09-11T01:58:36.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/615976239 >> v1:172.21.15.73:6790/0 conn(0x7f7ff80a72f0 legacy=0x7f7ff813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/615976239 shutdown_connections 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/615976239 >> 172.21.15.73:0/615976239 conn(0x7f7ff80a8050 msgr2=0x7f7ff80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/615976239 shutdown_connections 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.093+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/615976239 wait complete. 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.094+0000 7f7ffdbf3640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.094+0000 7f7ffdbf3640 10 monclient: monmap: 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.110 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.094+0000 7f7ffdbf3640 1 Processor -- start 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.094+0000 7f7ffdbf3640 1 -- start start 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.094+0000 7f7ffdbf3640 10 monclient: init 2024-09-11T01:58:36.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 10 monclient: _add_conns ranks=[0,7,8,3,6,5,1,4,2] 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 10 monclient(hunting): picked mon.noname-a con 0x7f7ff80a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 10 monclient(hunting): picked mon.noname-i con 0x7f7ff8138d40 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 10 monclient(hunting): picked mon.noname-e con 0x7f7ff813f350 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff80a4ec0 con 0x7f7ff80a72f0 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff813c7d0 con 0x7f7ff8138d40 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ff813cab0 con 0x7f7ff813f350 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ffdbf3640 10 monclient(hunting): authenticate will time out at 757.699305s 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ff77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7ff80a72f0 0x7f7ff81cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50554/0 (socket says 172.21.15.73:50554) 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7ff77fe640 1 -- 172.21.15.73:0/3722946142 learned_addr learned my addr 172.21.15.73:0/3722946142 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3698771003 0 0) 0x7f7fe0001a90 con 0x7f7ff80a72f0 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): my global_id is 4545 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fd8003520 con 0x7f7ff80a72f0 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494440487 0 0) 0x7f7ff813cab0 con 0x7f7ff813f350 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): my global_id is 4364 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe0001a90 con 0x7f7ff813f350 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789839054 0 0) 0x7f7ff813c7d0 con 0x7f7ff8138d40 2024-09-11T01:58:36.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): my global_id is 4417 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff813cab0 con 0x7f7ff8138d40 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 447171125 0 0) 0x7f7fd8003520 con 0x7f7ff80a72f0 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ff813c7d0 con 0x7f7ff80a72f0 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7fe0001810 con 0x7f7ff80a72f0 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): dump: 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.114 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:36.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2920731623 0 0) 0x7f7fe0001a90 con 0x7f7ff813f350 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fd8003520 con 0x7f7ff813f350 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7ff0001bf0 con 0x7f7ff813f350 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 10 monclient(hunting): dump: 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.116 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 587582229 0 0) 0x7f7ff813c7d0 con 0x7f7ff80a72f0 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.095+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 >> v1:172.21.15.73:6793/0 conn(0x7f7ff813f350 legacy=0x7f7ff81d5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 >> v1:172.21.15.203:6792/0 conn(0x7f7ff8138d40 legacy=0x7f7ff81cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 1 monclient: found mon.a 2024-09-11T01:58:36.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff81cdee0 con 0x7f7ff80a72f0 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ffdbf3640 5 monclient: authenticate success, global_id 4545 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ffdbf3640 10 monclient: _renew_subs 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ffdbf3640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff813b2b0 con 0x7f7ff80a72f0 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ffdbf3640 10 monclient: _renew_subs 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ffdbf3640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7ff813c210 con 0x7f7ff80a72f0 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fe0004a90 con 0x7f7ff80a72f0 2024-09-11T01:58:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7fe0005000 con 0x7f7ff80a72f0 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ff5ffb640 4 set_mon_vals no callback set 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7feffff640 10 monclient: dump: 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ffdbf3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.096+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7fdc0065c0 con 0x7f7fdc002860 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f7fe0011740 con 0x7f7ff80a72f0 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 3847258284 0 0) 0x7f7fe004e5c0 con 0x7f7ff80a72f0 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334467241 0 0) 0x7f7fdc0065c0 con 0x7f7fdc002860 2024-09-11T01:58:36.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 10 monclient(hunting): my global_id is 4373 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff813c7d0 con 0x7f7fdc002860 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 410975271 0 0) 0x7f7ff813c7d0 con 0x7f7fdc002860 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fdc0065c0 con 0x7f7fdc002860 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7fe8001c10 con 0x7f7fdc002860 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7ff7fff640 10 monclient: get_auth_request con 0x7f7fd80401e0 auth_method 0 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 10 monclient: dump: 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1132145991 0 0) 0x7f7fdc0065c0 con 0x7f7fdc002860 2024-09-11T01:58:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.097+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fdc00a160 con 0x7f7fdc002860 2024-09-11T01:58:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.098+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7fe8004fb0 con 0x7f7fdc002860 2024-09-11T01:58:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.098+0000 7f7feffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.098+0000 7f7feffff640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.098+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 >> v1:172.21.15.73:6793/0 conn(0x7f7fdc002860 legacy=0x7f7fdc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.098+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 >> v1:172.21.15.73:6793/0 conn(0x7f7fdc002860 legacy=0x7f7fdc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7ffdbf3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:58:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7fdc009e70 con 0x7f7fdc009130 2024-09-11T01:58:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 160701997 0 0) 0x7f7fdc009e70 con 0x7f7fdc009130 2024-09-11T01:58:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 10 monclient(hunting): my global_id is 4382 2024-09-11T01:58:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fdc0065c0 con 0x7f7fdc009130 2024-09-11T01:58:36.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1965431330 0 0) 0x7f7fdc0065c0 con 0x7f7fdc009130 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fdc009e70 con 0x7f7fdc009130 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7fe80057a0 con 0x7f7fdc009130 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 10 monclient: dump: 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.126 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.127 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2698508834 0 0) 0x7f7fdc009e70 con 0x7f7fdc009130 2024-09-11T01:58:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 --> v1:172.21.15.73:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7fdc00c410 con 0x7f7fdc009130 2024-09-11T01:58:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2787855349) 0x7f7fe8005a00 con 0x7f7fdc009130 2024-09-11T01:58:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:58:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 >> v1:172.21.15.73:6793/0 conn(0x7f7fdc009130 legacy=0x7f7fdc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.104+0000 7f7feffff640 1 -- 172.21.15.73:0/3722946142 >> v1:172.21.15.73:6793/0 conn(0x7f7fdc009130 legacy=0x7f7fdc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.128 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 8, 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 38540, 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:58:36.129 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 27, 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.130 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.131 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:58:36.132 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.133 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.134 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.135 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.136 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:36.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.138 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.139 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.141 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.142 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.144 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.145 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.147 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:58:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:36.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.149 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:58:36.149 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:58:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 >> v1:172.21.15.203:6812/2311533528 conn(0x7f7fd80401e0 legacy=0x7f7fd80426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ffdbf3640 10 monclient: shutdown 2024-09-11T01:58:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ffdbf3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 >> v1:172.21.15.73:6789/0 conn(0x7f7ff80a72f0 legacy=0x7f7ff81cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ff7fff640 1 -- 172.21.15.73:0/3722946142 reap_dead start 2024-09-11T01:58:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ff7fff640 1 -- 172.21.15.73:0/3722946142 reap_dead start 2024-09-11T01:58:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 shutdown_connections 2024-09-11T01:58:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 >> 172.21.15.73:0/3722946142 conn(0x7f7ff80a8050 msgr2=0x7f7ff80a95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 shutdown_connections 2024-09-11T01:58:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.105+0000 7f7ffdbf3640 1 -- 172.21.15.73:0/3722946142 wait complete. 2024-09-11T01:58:36.151 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T01:58:36.151 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-11T01:58:36.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-11T01:58:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.248+0000 7f8db3057640 10 monclient: get_monmap_and_config 2024-09-11T01:58:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.248+0000 7f8db3057640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.248+0000 7f8db3057640 10 monclient: monmap: 2024-09-11T01:58:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:36.249615+0000 2024-09-11T01:58:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:36.249615+0000 2024-09-11T01:58:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.255 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.249+0000 7f8db3057640 1 Processor -- start 2024-09-11T01:58:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.249+0000 7f8db3057640 1 -- start start 2024-09-11T01:58:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.249+0000 7f8db3057640 10 monclient: init 2024-09-11T01:58:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.249+0000 7f8db3057640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.249+0000 7f8db3057640 10 monclient: _add_conns ranks=[1,6,2,0,5,7,4,8,3] 2024-09-11T01:58:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.249+0000 7f8db3057640 10 monclient(hunting): picked mon.noname-f con 0x7f8dac138d40 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.249+0000 7f8db3057640 10 monclient(hunting): picked mon.noname-d con 0x7f8dac0a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.249+0000 7f8db3057640 10 monclient(hunting): picked mon.noname-b con 0x7f8dac13f350 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac09ca00 con 0x7f8dac138d40 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac0a7070 con 0x7f8dac13f350 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac09cee0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 10 monclient(hunting): authenticate will time out at 757.854037s 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dabfff640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f8dac0a72f0 0x7f8dac13dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:35158/0 (socket says 172.21.15.73:35158) 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db15f4640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f8dac13f350 0x7f8dac141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53720/0 (socket says 172.21.15.73:53720) 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dabfff640 1 -- 172.21.15.73:0/2891026956 learned_addr learned my addr 172.21.15.73:0/2891026956 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3249521367 0 0) 0x7f8dac09cee0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): my global_id is 4416 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d9c003520 con 0x7f8dac0a72f0 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657856937 0 0) 0x7f8dac0a7070 con 0x7f8dac13f350 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): my global_id is 4484 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dac09cee0 con 0x7f8dac13f350 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258058460 0 0) 0x7f8dac09ca00 con 0x7f8dac138d40 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient(hunting): my global_id is 4420 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dac0a7070 con 0x7f8dac138d40 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3794416559 0 0) 0x7f8d9c003520 con 0x7f8dac0a72f0 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 >> v1:172.21.15.73:6790/0 conn(0x7f8dac13f350 legacy=0x7f8dac141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 >> v1:172.21.15.203:6789/0 conn(0x7f8dac138d40 legacy=0x7f8dac139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 monclient: found mon.noname-d 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac09d1c0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 5 monclient: authenticate success, global_id 4416 2024-09-11T01:58:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d98001830 con 0x7f8dac0a72f0 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: dump: 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d980019d0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 1 -- 172.21.15.73:0/2891026956 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d98004be0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8db3057640 4 set_mon_vals no callback set 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.250+0000 7f8dab7fe640 10 monclient: dump: 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.251+0000 7f8db3057640 10 monclient: shutdown 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.251+0000 7f8db3057640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.251+0000 7f8db3057640 1 -- 172.21.15.73:0/2891026956 >> v1:172.21.15.73:6792/0 conn(0x7f8dac0a72f0 legacy=0x7f8dac13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.251+0000 7f8db3057640 1 -- 172.21.15.73:0/2891026956 shutdown_connections 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.251+0000 7f8db3057640 1 -- 172.21.15.73:0/2891026956 >> 172.21.15.73:0/2891026956 conn(0x7f8dac0a8050 msgr2=0x7f8dac0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.251+0000 7f8db3057640 1 -- 172.21.15.73:0/2891026956 shutdown_connections 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.251+0000 7f8db3057640 1 -- 172.21.15.73:0/2891026956 wait complete. 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.251+0000 7f8db3057640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.251+0000 7f8db3057640 10 monclient: monmap: 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 1 Processor -- start 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 1 -- start start 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 10 monclient: init 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 10 monclient: _add_conns ranks=[6,2,4,0,7,8,3,1,5] 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 10 monclient(hunting): picked mon.noname-d con 0x7f8dac0a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 10 monclient(hunting): picked mon.noname-b con 0x7f8dac138d40 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 10 monclient(hunting): picked mon.noname-c con 0x7f8dac13f350 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac13e4d0 con 0x7f8dac138d40 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac09fa60 con 0x7f8dac13f350 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac13e9f0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db3057640 10 monclient(hunting): authenticate will time out at 757.856814s 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8dabfff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f8dac138d40 0x7f8dac09f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53734/0 (socket says 172.21.15.73:53734) 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8dabfff640 1 -- 172.21.15.73:0/1657413470 learned_addr learned my addr 172.21.15.73:0/1657413470 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.252+0000 7f8db0df3640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f8dac0a72f0 0x7f8dac09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:35168/0 (socket says 172.21.15.73:35168) 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4254224350 0 0) 0x7f8dac13e4d0 con 0x7f8dac138d40 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): my global_id is 4493 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d90003550 con 0x7f8dac138d40 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300126119 0 0) 0x7f8dac13e9f0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): my global_id is 4425 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dac13e4d0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605476529 0 0) 0x7f8dac09fa60 con 0x7f8dac13f350 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): my global_id is 4459 2024-09-11T01:58:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dac13e9f0 con 0x7f8dac13f350 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 558253422 0 0) 0x7f8dac13e4d0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8dac09fa60 con 0x7f8dac0a72f0 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8da0001ad0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): dump: 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.279 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1619241106 0 0) 0x7f8d90003550 con 0x7f8dac138d40 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8dac13e4d0 con 0x7f8dac138d40 2024-09-11T01:58:36.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d98004c60 con 0x7f8dac138d40 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): dump: 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 468168637 0 0) 0x7f8dac13e9f0 con 0x7f8dac13f350 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d90003550 con 0x7f8dac13f350 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8da4001c20 con 0x7f8dac13f350 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient(hunting): dump: 2024-09-11T01:58:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1193359532 0 0) 0x7f8dac09fa60 con 0x7f8dac0a72f0 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 >> v1:172.21.15.73:6791/0 conn(0x7f8dac13f350 legacy=0x7f8dac1d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 >> v1:172.21.15.73:6790/0 conn(0x7f8dac138d40 legacy=0x7f8dac09f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 monclient: found mon.d 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac0a1230 con 0x7f8dac0a72f0 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8db3057640 5 monclient: authenticate success, global_id 4425 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8db3057640 10 monclient: _renew_subs 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8db3057640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac1426d0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8db3057640 10 monclient: _renew_subs 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8db3057640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f8dac138690 con 0x7f8dac0a72f0 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8da00038c0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8da0003e30 con 0x7f8dac0a72f0 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8daaffd640 4 set_mon_vals no callback set 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.253+0000 7f8da97fa640 10 monclient: dump: 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8db3057640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f8da0003fd0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8d8c0065c0 con 0x7f8d8c002860 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 3847258284 0 0) 0x7f8da004e3d0 con 0x7f8dac0a72f0 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8db15f4640 10 monclient: get_auth_request con 0x7f8d900407b0 auth_method 0 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581710557 0 0) 0x7f8d8c0065c0 con 0x7f8d8c002860 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8da97fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8da97fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8da97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8da97fa640 10 monclient(hunting): my global_id is 4429 2024-09-11T01:58:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.254+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dac09fa60 con 0x7f8d8c002860 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2878721507 0 0) 0x7f8dac09fa60 con 0x7f8d8c002860 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d8c0065c0 con 0x7f8d8c002860 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d98001950 con 0x7f8d8c002860 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 10 monclient: dump: 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3354118819 0 0) 0x7f8d8c0065c0 con 0x7f8d8c002860 2024-09-11T01:58:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.203:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d8c00a160 con 0x7f8d8c002860 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8d98005080 con 0x7f8d8c002860 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 >> v1:172.21.15.203:6789/0 conn(0x7f8d8c002860 legacy=0x7f8d8c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.255+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 >> v1:172.21.15.203:6789/0 conn(0x7f8d8c002860 legacy=0x7f8d8c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.261+0000 7f8db3057640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.261+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8d8c009e70 con 0x7f8d8c009130 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034330181 0 0) 0x7f8d8c009e70 con 0x7f8d8c009130 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 10 monclient(hunting): my global_id is 4438 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d8c0065c0 con 0x7f8d8c009130 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1142877880 0 0) 0x7f8d8c0065c0 con 0x7f8d8c009130 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d8c009e70 con 0x7f8d8c009130 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8d98005820 con 0x7f8d8c009130 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 10 monclient: dump: 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2620576304 0 0) 0x7f8d8c009e70 con 0x7f8d8c009130 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.262+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 --> v1:172.21.15.203:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8d8c00c410 con 0x7f8d8c009130 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 243982855) 0x7f8d98005a80 con 0x7f8d8c009130 2024-09-11T01:58:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8da97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:58:36.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8da97fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:36.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 >> v1:172.21.15.203:6789/0 conn(0x7f8d8c009130 legacy=0x7f8d8c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8da97fa640 1 -- 172.21.15.73:0/1657413470 >> v1:172.21.15.203:6789/0 conn(0x7f8d8c009130 legacy=0x7f8d8c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.293 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:58:36.293 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:36.293 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:36.293 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:58:36.293 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 8, 2024-09-11T01:58:36.293 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 38678, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 27, 2024-09-11T01:58:36.294 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.295 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.296 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:58:36.297 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.298 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.299 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.301 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:36.301 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:36.301 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.301 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.301 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:58:36.301 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:36.302 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.305 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:58:36.306 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.306 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.306 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.306 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.306 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.306 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.307 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.308 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:36.309 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.310 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.311 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:36.312 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:58:36.313 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 >> v1:172.21.15.203:6812/2311533528 conn(0x7f8d900407b0 legacy=0x7f8d90042c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db3057640 10 monclient: shutdown 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db3057640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 >> v1:172.21.15.73:6792/0 conn(0x7f8dac0a72f0 legacy=0x7f8dac09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db15f4640 1 -- 172.21.15.73:0/1657413470 reap_dead start 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db15f4640 1 -- 172.21.15.73:0/1657413470 reap_dead start 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 shutdown_connections 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 >> 172.21.15.73:0/1657413470 conn(0x7f8dac0a8050 msgr2=0x7f8dac13ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 shutdown_connections 2024-09-11T01:58:36.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.263+0000 7f8db3057640 1 -- 172.21.15.73:0/1657413470 wait complete. 2024-09-11T01:58:36.316 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T01:58:36.316 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-11T01:58:36.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-11T01:58:36.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.412+0000 7f65308bf640 10 monclient: get_monmap_and_config 2024-09-11T01:58:36.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.412+0000 7f65308bf640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.412+0000 7f65308bf640 10 monclient: monmap: 2024-09-11T01:58:36.415 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.415 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.415 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:36.413797+0000 2024-09-11T01:58:36.415 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:36.413797+0000 2024-09-11T01:58:36.415 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.415 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.416 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.413+0000 7f65308bf640 1 Processor -- start 2024-09-11T01:58:36.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.413+0000 7f65308bf640 1 -- start start 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.413+0000 7f65308bf640 10 monclient: init 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 10 monclient: _add_conns ranks=[5,3,0,7,6,8,4,1,2] 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 10 monclient(hunting): picked mon.noname-h con 0x7f652c138d40 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 10 monclient(hunting): picked mon.noname-g con 0x7f652c0a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 10 monclient(hunting): picked mon.noname-a con 0x7f652c13f350 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c09ca00 con 0x7f652c13f350 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c0a7070 con 0x7f652c0a72f0 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c09cee0 con 0x7f652c138d40 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 10 monclient(hunting): authenticate will time out at 758.018294s 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652ad9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f652c13f350 0x7f652c141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50558/0 (socket says 172.21.15.73:50558) 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652ad9d640 1 -- 172.21.15.73:0/77448411 learned_addr learned my addr 172.21.15.73:0/77448411 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828787532 0 0) 0x7f652c09ca00 con 0x7f652c13f350 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): my global_id is 4554 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6514003520 con 0x7f652c13f350 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093735235 0 0) 0x7f652c0a7070 con 0x7f652c0a72f0 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): my global_id is 4521 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c09ca00 con 0x7f652c0a72f0 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374199941 0 0) 0x7f652c09cee0 con 0x7f652c138d40 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient(hunting): my global_id is 4478 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c0a7070 con 0x7f652c138d40 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2847965145 0 0) 0x7f6514003520 con 0x7f652c13f350 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 >> v1:172.21.15.203:6791/0 conn(0x7f652c138d40 legacy=0x7f652c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 >> v1:172.21.15.203:6790/0 conn(0x7f652c0a72f0 legacy=0x7f652c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 monclient: found mon.noname-a 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c09d1c0 con 0x7f652c13f350 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 5 monclient: authenticate success, global_id 4554 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6524001b50 con 0x7f652c13f350 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient: dump: 2024-09-11T01:58:36.430 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.431 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f65308bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6524001cf0 con 0x7f652c13f350 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.414+0000 7f652959a640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f652959a640 1 -- 172.21.15.73:0/77448411 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6524004f60 con 0x7f652c13f350 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f652959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f652959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f652959a640 10 monclient: dump: 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.432 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f65308bf640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:36.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f65308bf640 4 set_mon_vals no callback set 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f65308bf640 10 monclient: shutdown 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f65308bf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f65308bf640 1 -- 172.21.15.73:0/77448411 >> v1:172.21.15.73:6789/0 conn(0x7f652c13f350 legacy=0x7f652c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f65308bf640 1 -- 172.21.15.73:0/77448411 shutdown_connections 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f65308bf640 1 -- 172.21.15.73:0/77448411 >> 172.21.15.73:0/77448411 conn(0x7f652c0a8050 msgr2=0x7f652c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f65308bf640 1 -- 172.21.15.73:0/77448411 shutdown_connections 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.415+0000 7f65308bf640 1 -- 172.21.15.73:0/77448411 wait complete. 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.416+0000 7f65308bf640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.416+0000 7f65308bf640 10 monclient: monmap: 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:36.434 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.416+0000 7f65308bf640 1 Processor -- start 2024-09-11T01:58:36.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.416+0000 7f65308bf640 1 -- start start 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.416+0000 7f65308bf640 10 monclient: init 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 10 monclient: _add_conns ranks=[2,5,0,8,7,4,6,1,3] 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 10 monclient(hunting): picked mon.noname-b con 0x7f652c0a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 10 monclient(hunting): picked mon.noname-h con 0x7f652c138d40 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 10 monclient(hunting): picked mon.noname-a con 0x7f652c13f350 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c13a800 con 0x7f652c13f350 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c13c4d0 con 0x7f652c0a72f0 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c13cd70 con 0x7f652c138d40 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 10 monclient(hunting): authenticate will time out at 758.021196s 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f652a59c640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f652c0a72f0 0x7f652c1399e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53750/0 (socket says 172.21.15.73:53750) 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f652ad9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f652c13f350 0x7f652c1d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50570/0 (socket says 172.21.15.73:50570) 2024-09-11T01:58:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f652a59c640 1 -- 172.21.15.73:0/29026297 learned_addr learned my addr 172.21.15.73:0/29026297 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2191993389 0 0) 0x7f652c13a800 con 0x7f652c13f350 2024-09-11T01:58:36.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): my global_id is 4563 2024-09-11T01:58:36.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f650c003520 con 0x7f652c13f350 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507234333 0 0) 0x7f652c13c4d0 con 0x7f652c0a72f0 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): my global_id is 4502 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c13a800 con 0x7f652c0a72f0 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087207360 0 0) 0x7f652c13cd70 con 0x7f652c138d40 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): my global_id is 4487 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c13c4d0 con 0x7f652c138d40 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 698626987 0 0) 0x7f652c13a800 con 0x7f652c0a72f0 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f652c13cd70 con 0x7f652c0a72f0 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f651c001b00 con 0x7f652c0a72f0 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): dump: 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.439 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.440 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3050239977 0 0) 0x7f652c13c4d0 con 0x7f652c138d40 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f652c13a800 con 0x7f652c138d40 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3680130074 0 0) 0x7f650c003520 con 0x7f652c13f350 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f652c13c4d0 con 0x7f652c13f350 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6520001980 con 0x7f652c138d40 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): dump: 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6524001a90 con 0x7f652c13f350 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient(hunting): dump: 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.443 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3026102483 0 0) 0x7f652c13cd70 con 0x7f652c0a72f0 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 >> v1:172.21.15.203:6791/0 conn(0x7f652c138d40 legacy=0x7f652c13a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 >> v1:172.21.15.73:6789/0 conn(0x7f652c13f350 legacy=0x7f652c1d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 monclient: found mon.b 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c13e4d0 con 0x7f652c0a72f0 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f651affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 5 monclient: authenticate success, global_id 4502 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 10 monclient: _renew_subs 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.417+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f652c13e760 con 0x7f652c0a72f0 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f65308bf640 10 monclient: _renew_subs 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f65308bf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f652c0a1390 con 0x7f652c0a72f0 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f651c0038c0 con 0x7f652c0a72f0 2024-09-11T01:58:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f651affd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f651c003e30 con 0x7f652c0a72f0 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f6528d99640 4 set_mon_vals no callback set 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f651affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f651affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f651affd640 10 monclient: dump: 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f65308bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f65100065c0 con 0x7f6510002860 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.418+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f651c004050 con 0x7f652c0a72f0 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 3847258284 0 0) 0x7f651c04e4d0 con 0x7f652c0a72f0 2024-09-11T01:58:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f652ad9d640 10 monclient: get_auth_request con 0x7f650c040790 auth_method 0 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466980039 0 0) 0x7f65100065c0 con 0x7f6510002860 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 10 monclient(hunting): my global_id is 4530 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f652c13cd70 con 0x7f6510002860 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4132373944 0 0) 0x7f652c13cd70 con 0x7f6510002860 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65100065c0 con 0x7f6510002860 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6520003930 con 0x7f6510002860 2024-09-11T01:58:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 10 monclient: dump: 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3909603031 0 0) 0x7f65100065c0 con 0x7f6510002860 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.419+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f651000a160 con 0x7f6510002860 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.420+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6520005bb0 con 0x7f6510002860 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.420+0000 7f651affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.420+0000 7f651affd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.420+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 >> v1:172.21.15.203:6790/0 conn(0x7f6510002860 legacy=0x7f6510004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.420+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 >> v1:172.21.15.203:6790/0 conn(0x7f6510002860 legacy=0x7f6510004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f65308bf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:58:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6510009e20 con 0x7f65100090e0 2024-09-11T01:58:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633316761 0 0) 0x7f6510009e20 con 0x7f65100090e0 2024-09-11T01:58:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 10 monclient(hunting): my global_id is 4539 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65100065c0 con 0x7f65100090e0 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2954455365 0 0) 0x7f65100065c0 con 0x7f65100090e0 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6510009e20 con 0x7f65100090e0 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f65200054e0 con 0x7f65100090e0 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.426+0000 7f651affd640 10 monclient: dump: 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.455 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.456 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1519894065 0 0) 0x7f6510009e20 con 0x7f65100090e0 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 --> v1:172.21.15.203:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f651000c3f0 con 0x7f65100090e0 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7710 (unknown 0 0 548603071) 0x7f6520005740 con 0x7f65100090e0 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f651affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f651affd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 >> v1:172.21.15.203:6790/0 conn(0x7f65100090e0 legacy=0x7f6510009570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f651affd640 1 -- 172.21.15.73:0/29026297 >> v1:172.21.15.203:6790/0 conn(0x7f65100090e0 legacy=0x7f6510009570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:58:36.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 8, 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 38865, 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:58:36.458 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 27, 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.459 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.460 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:58:36.461 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:58:36.462 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.463 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:58:36.464 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.465 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.466 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.466 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:58:36.466 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.466 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.466 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.468 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.469 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:36.470 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:36.470 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.470 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.470 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.470 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:58:36.470 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.470 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.470 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.473 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:58:36.474 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:36.475 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.476 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.476 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.476 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:58:36.476 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.476 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:36.477 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:58:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.478 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.479 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:58:36.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.481 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.481 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.481 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-09-11T01:58:36.481 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.481 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.481 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:58:36.481 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:58:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 >> v1:172.21.15.203:6812/2311533528 conn(0x7f650c040790 legacy=0x7f650c042c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f65308bf640 10 monclient: shutdown 2024-09-11T01:58:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f65308bf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 >> v1:172.21.15.73:6790/0 conn(0x7f652c0a72f0 legacy=0x7f652c1399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f652ad9d640 1 -- 172.21.15.73:0/29026297 reap_dead start 2024-09-11T01:58:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f652ad9d640 1 -- 172.21.15.73:0/29026297 reap_dead start 2024-09-11T01:58:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 shutdown_connections 2024-09-11T01:58:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.427+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 >> 172.21.15.73:0/29026297 conn(0x7f652c0a8050 msgr2=0x7f652c0a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.428+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 shutdown_connections 2024-09-11T01:58:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.428+0000 7f65308bf640 1 -- 172.21.15.73:0/29026297 wait complete. 2024-09-11T01:58:36.484 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T01:58:36.484 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-11T01:58:36.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-11T01:58:36.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.581+0000 7f807859b640 10 monclient: get_monmap_and_config 2024-09-11T01:58:36.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.581+0000 7f807859b640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.581+0000 7f807859b640 10 monclient: monmap: 2024-09-11T01:58:36.584 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.584 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.584 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:36.582386+0000 2024-09-11T01:58:36.584 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:36.582386+0000 2024-09-11T01:58:36.584 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.585 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 1 Processor -- start 2024-09-11T01:58:36.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 1 -- start start 2024-09-11T01:58:36.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 10 monclient: init 2024-09-11T01:58:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 10 monclient: _add_conns ranks=[0,6,8,1,2,3,5,7,4] 2024-09-11T01:58:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 10 monclient(hunting): picked mon.noname-a con 0x7f8070138e40 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 10 monclient(hunting): picked mon.noname-d con 0x7f8070139220 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 10 monclient(hunting): picked mon.noname-e con 0x7f807013f250 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807009d190 con 0x7f8070138e40 2024-09-11T01:58:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807009e280 con 0x7f8070139220 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807009ceb0 con 0x7f807013f250 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f807859b640 10 monclient(hunting): authenticate will time out at 758.186931s 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.582+0000 7f8076337640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8070138e40 0x7f807009db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50580/0 (socket says 172.21.15.73:50580) 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8076337640 1 -- 172.21.15.73:0/3243561297 learned_addr learned my addr 172.21.15.73:0/3243561297 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186613120 0 0) 0x7f807009e280 con 0x7f8070139220 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): my global_id is 4434 2024-09-11T01:58:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f805c003520 con 0x7f8070139220 2024-09-11T01:58:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798306504 0 0) 0x7f8060001040 con 0x7f8070138e40 2024-09-11T01:58:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): my global_id is 4572 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f807009e280 con 0x7f8070138e40 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027729117 0 0) 0x7f807009ceb0 con 0x7f807013f250 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient(hunting): my global_id is 4391 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8060001040 con 0x7f807013f250 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 335194156 0 0) 0x7f805c003520 con 0x7f8070139220 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 >> v1:172.21.15.73:6793/0 conn(0x7f807013f250 legacy=0x7f8070141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 >> v1:172.21.15.73:6789/0 conn(0x7f8070138e40 legacy=0x7f807009db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 monclient: found mon.noname-d 2024-09-11T01:58:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807009d470 con 0x7f8070139220 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f806c001830 con 0x7f8070139220 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: dump: 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f807859b640 5 monclient: authenticate success, global_id 4434 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f807859b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f806c001a50 con 0x7f8070139220 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 1 -- 172.21.15.73:0/3243561297 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f806c003950 con 0x7f8070139220 2024-09-11T01:58:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f807859b640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:36.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f807859b640 4 set_mon_vals no callback set 2024-09-11T01:58:36.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T01:58:36.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.583+0000 7f8075335640 10 monclient: dump: 2024-09-11T01:58:36.603 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.603 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.603 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.604 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.584+0000 7f807859b640 10 monclient: shutdown 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.584+0000 7f807859b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.584+0000 7f807859b640 1 -- 172.21.15.73:0/3243561297 >> v1:172.21.15.73:6792/0 conn(0x7f8070139220 legacy=0x7f807013db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.584+0000 7f807859b640 1 -- 172.21.15.73:0/3243561297 shutdown_connections 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.584+0000 7f807859b640 1 -- 172.21.15.73:0/3243561297 >> 172.21.15.73:0/3243561297 conn(0x7f80700abe10 msgr2=0x7f80700a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.584+0000 7f807859b640 1 -- 172.21.15.73:0/3243561297 shutdown_connections 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.584+0000 7f807859b640 1 -- 172.21.15.73:0/3243561297 wait complete. 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.584+0000 7f807859b640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.584+0000 7f807859b640 10 monclient: monmap: 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.605 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.606 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 1 Processor -- start 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 1 -- start start 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 10 monclient: init 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 10 monclient: _add_conns ranks=[3,1,2,7,0,5,6,8,4] 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 10 monclient(hunting): picked mon.noname-g con 0x7f8070138e40 addr v1:172.21.15.203:6790/0 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 10 monclient(hunting): picked mon.noname-f con 0x7f8070139220 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 10 monclient(hunting): picked mon.noname-b con 0x7f807013f250 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807013da30 con 0x7f8070139220 2024-09-11T01:58:36.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80700a9a20 con 0x7f807013f250 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80700a48b0 con 0x7f8070138e40 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f807859b640 10 monclient(hunting): authenticate will time out at 758.189714s 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f8076b38640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f807013f250 0x7f80701d5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53766/0 (socket says 172.21.15.73:53766) 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f8076b38640 1 -- 172.21.15.73:0/3692131944 learned_addr learned my addr 172.21.15.73:0/3692131944 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.585+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477785968 0 0) 0x7f80700a9a20 con 0x7f807013f250 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): my global_id is 4511 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8054003520 con 0x7f807013f250 2024-09-11T01:58:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3344940337 0 0) 0x7f807013da30 con 0x7f8070139220 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): my global_id is 4447 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80700a9a20 con 0x7f8070139220 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436718918 0 0) 0x7f80700a48b0 con 0x7f8070138e40 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): my global_id is 4548 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f807013da30 con 0x7f8070138e40 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3975118986 0 0) 0x7f8054003520 con 0x7f807013f250 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80700a48b0 con 0x7f807013f250 2024-09-11T01:58:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8068001cd0 con 0x7f807013f250 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): dump: 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3045143696 0 0) 0x7f80700a48b0 con 0x7f807013f250 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 >> v1:172.21.15.203:6790/0 conn(0x7f8070138e40 legacy=0x7f80700a3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 >> v1:172.21.15.203:6789/0 conn(0x7f8070139220 legacy=0x7f80700a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 monclient: found mon.b 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807013ade0 con 0x7f807013f250 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f807859b640 5 monclient: authenticate success, global_id 4511 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f807859b640 10 monclient: _renew_subs 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f807859b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f807013a540 con 0x7f807013f250 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f807859b640 10 monclient: _renew_subs 2024-09-11T01:58:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f807859b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8070139900 con 0x7f807013f250 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8068003970 con 0x7f807013f250 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8068003f60 con 0x7f807013f250 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8066ffd640 10 monclient: dump: 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.614 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.614 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.614 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.614 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.614 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.614 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.614 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.614 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.614 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.586+0000 7f8074b34640 4 set_mon_vals no callback set 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f807859b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f80580065c0 con 0x7f8058002860 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f8068004180 con 0x7f807013f250 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 3847258284 0 0) 0x7f806804e530 con 0x7f807013f250 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132040735 0 0) 0x7f80580065c0 con 0x7f8058002860 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f8066ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f8066ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f8066ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f8066ffd640 10 monclient(hunting): my global_id is 4496 2024-09-11T01:58:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80700a48b0 con 0x7f8058002860 2024-09-11T01:58:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.587+0000 7f8075b36640 10 monclient: get_auth_request con 0x7f805403fee0 auth_method 0 2024-09-11T01:58:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2921426331 0 0) 0x7f80700a48b0 con 0x7f8058002860 2024-09-11T01:58:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80580065c0 con 0x7f8058002860 2024-09-11T01:58:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8060001650 con 0x7f8058002860 2024-09-11T01:58:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 10 monclient: dump: 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.617 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1926892689 0 0) 0x7f80580065c0 con 0x7f8058002860 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f805800a160 con 0x7f8058002860 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8060001900 con 0x7f8058002860 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 >> v1:172.21.15.203:6791/0 conn(0x7f8058002860 legacy=0x7f8058004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.588+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 >> v1:172.21.15.203:6791/0 conn(0x7f8058002860 legacy=0x7f8058004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.594+0000 7f807859b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:58:36.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.594+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8058009e70 con 0x7f8058009130 2024-09-11T01:58:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808874956 0 0) 0x7f8058009e70 con 0x7f8058009130 2024-09-11T01:58:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 10 monclient(hunting): my global_id is 4505 2024-09-11T01:58:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80580065c0 con 0x7f8058009130 2024-09-11T01:58:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 932216138 0 0) 0x7f80580065c0 con 0x7f8058009130 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8058009e70 con 0x7f8058009130 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8060004e20 con 0x7f8058009130 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 10 monclient: dump: 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.621 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2029815357 0 0) 0x7f8058009e70 con 0x7f8058009130 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.595+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 --> v1:172.21.15.203:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f805800c3f0 con 0x7f8058009130 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 1916492365) 0x7f80600062d0 con 0x7f8058009130 2024-09-11T01:58:36.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f8066ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:58:36.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f8066ffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:36.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 >> v1:172.21.15.203:6791/0 conn(0x7f8058009130 legacy=0x7f80580095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f8066ffd640 1 -- 172.21.15.73:0/3692131944 >> v1:172.21.15.203:6791/0 conn(0x7f8058009130 legacy=0x7f80580095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.623 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:58:36.623 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:36.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:36.623 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:58:36.623 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 8, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 39032, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.624 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 27, 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.625 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.626 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.627 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.628 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:36.629 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.630 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.632 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.633 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:58:36.633 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.633 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.633 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.633 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.633 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:58:36.634 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.635 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.636 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.636 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:58:36.636 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.636 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.636 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:58:36.638 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.638 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.638 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.638 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.638 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.638 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.638 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.639 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.640 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.640 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.640 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.640 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.640 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.640 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:58:36.642 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:58:36.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.644 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:58:36.645 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:58:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 >> v1:172.21.15.203:6812/2311533528 conn(0x7f805403fee0 legacy=0x7f80540423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f807859b640 10 monclient: shutdown 2024-09-11T01:58:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f8076b38640 1 -- 172.21.15.73:0/3692131944 reap_dead start 2024-09-11T01:58:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f807859b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 >> v1:172.21.15.73:6790/0 conn(0x7f807013f250 legacy=0x7f80701d5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 shutdown_connections 2024-09-11T01:58:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 >> 172.21.15.73:0/3692131944 conn(0x7f80700abe10 msgr2=0x7f80700a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 shutdown_connections 2024-09-11T01:58:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.596+0000 7f807859b640 1 -- 172.21.15.73:0/3692131944 wait complete. 2024-09-11T01:58:36.647 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T01:58:36.647 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-11T01:58:36.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-11T01:58:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.744+0000 7f7a533ec640 10 monclient: get_monmap_and_config 2024-09-11T01:58:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.744+0000 7f7a533ec640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.744+0000 7f7a533ec640 10 monclient: monmap: 2024-09-11T01:58:36.746 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:36.745622+0000 2024-09-11T01:58:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:36.745622+0000 2024-09-11T01:58:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.747 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.748 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.748 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.748 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.748 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.748 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.748 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.748 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.748 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.748 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.745+0000 7f7a533ec640 1 Processor -- start 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.745+0000 7f7a533ec640 1 -- start start 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.745+0000 7f7a533ec640 10 monclient: init 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.745+0000 7f7a533ec640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.745+0000 7f7a533ec640 10 monclient: _add_conns ranks=[2,4,1,8,5,7,0,6,3] 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 10 monclient(hunting): picked mon.noname-b con 0x7f7a4c138d40 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 10 monclient(hunting): picked mon.noname-c con 0x7f7a4c0a72f0 addr v1:172.21.15.73:6791/0 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 10 monclient(hunting): picked mon.noname-f con 0x7f7a4c13f350 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4c09ca00 con 0x7f7a4c13f350 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4c0a7070 con 0x7f7a4c138d40 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4c09cee0 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 10 monclient(hunting): authenticate will time out at 758.350080s 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a51188640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f7a4c138d40 0x7f7a4c139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:53772/0 (socket says 172.21.15.73:53772) 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a51188640 1 -- 172.21.15.73:0/95555241 learned_addr learned my addr 172.21.15.73:0/95555241 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a50987640 1 --1- 172.21.15.73:0/95555241 >> v1:172.21.15.73:6791/0 conn(0x7f7a4c0a72f0 0x7f7a4c13dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49334/0 (socket says 172.21.15.73:49334) 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443934660 0 0) 0x7f7a4c09cee0 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): my global_id is 4468 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a38003520 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702571389 0 0) 0x7f7a4c0a7070 con 0x7f7a4c138d40 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): my global_id is 4520 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a4c09cee0 con 0x7f7a4c138d40 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056111878 0 0) 0x7f7a4c09ca00 con 0x7f7a4c13f350 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient(hunting): my global_id is 4456 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a4c0a7070 con 0x7f7a4c13f350 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1357776830 0 0) 0x7f7a38003520 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 >> v1:172.21.15.73:6790/0 conn(0x7f7a4c138d40 legacy=0x7f7a4c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 >> v1:172.21.15.203:6789/0 conn(0x7f7a4c13f350 legacy=0x7f7a4c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 monclient: found mon.noname-c 2024-09-11T01:58:36.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c09d1c0 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7a3c001830 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 5 monclient: authenticate success, global_id 4468 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: dump: 2024-09-11T01:58:36.764 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.765 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a3c0019d0 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 1 -- 172.21.15.73:0/95555241 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7a3c004b20 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a533ec640 4 set_mon_vals no callback set 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.746+0000 7f7a43fff640 10 monclient: dump: 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.747+0000 7f7a533ec640 10 monclient: shutdown 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.747+0000 7f7a533ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.747+0000 7f7a533ec640 1 -- 172.21.15.73:0/95555241 >> v1:172.21.15.73:6791/0 conn(0x7f7a4c0a72f0 legacy=0x7f7a4c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.747+0000 7f7a533ec640 1 -- 172.21.15.73:0/95555241 shutdown_connections 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.747+0000 7f7a533ec640 1 -- 172.21.15.73:0/95555241 >> 172.21.15.73:0/95555241 conn(0x7f7a4c0a8050 msgr2=0x7f7a4c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.747+0000 7f7a533ec640 1 -- 172.21.15.73:0/95555241 shutdown_connections 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.747+0000 7f7a533ec640 1 -- 172.21.15.73:0/95555241 wait complete. 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.747+0000 7f7a533ec640 10 monclient: build_initial_monmap 2024-09-11T01:58:36.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.747+0000 7f7a533ec640 10 monclient: monmap: 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:36.769 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 1 Processor -- start 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 1 -- start start 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 10 monclient: init 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 10 monclient: _add_conns ranks=[0,7,5,8,6,2,1,4,3] 2024-09-11T01:58:36.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 10 monclient(hunting): picked mon.noname-a con 0x7f7a4c0a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 10 monclient(hunting): picked mon.noname-i con 0x7f7a4c138d40 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 10 monclient(hunting): picked mon.noname-h con 0x7f7a4c13f350 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4c13cdb0 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4c13a800 con 0x7f7a4c13f350 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a4c13aac0 con 0x7f7a4c138d40 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a533ec640 10 monclient(hunting): authenticate will time out at 758.352833s 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a51188640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7a4c0a72f0 0x7f7a4c1399e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50582/0 (socket says 172.21.15.73:50582) 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.748+0000 7f7a51188640 1 -- 172.21.15.73:0/1852808411 learned_addr learned my addr 172.21.15.73:0/1852808411 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338384979 0 0) 0x7f7a4c13cdb0 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): my global_id is 4581 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a30003550 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3310523519 0 0) 0x7f7a30003550 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a4c13cdb0 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7a48001690 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): dump: 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.772 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.773 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080068951 0 0) 0x7f7a4c13a800 con 0x7f7a4c13f350 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): my global_id is 4514 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a30003550 con 0x7f7a4c13f350 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065131636 0 0) 0x7f7a4c13aac0 con 0x7f7a4c138d40 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient(hunting): my global_id is 4426 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a4c13a800 con 0x7f7a4c138d40 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3197976989 0 0) 0x7f7a4c13cdb0 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 >> v1:172.21.15.203:6792/0 conn(0x7f7a4c138d40 legacy=0x7f7a4c13a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 >> v1:172.21.15.203:6791/0 conn(0x7f7a4c13f350 legacy=0x7f7a4c1d56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient: _finish_hunting 0 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 monclient: found mon.a 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:36.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c13c510 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient: _finish_auth 0 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient: _check_auth_tickets 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a533ec640 5 monclient: authenticate success, global_id 4581 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a533ec640 10 monclient: _renew_subs 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a533ec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c0a1490 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a48004a90 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7a48004f80 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a41ffb640 10 monclient: dump: 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.777 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a533ec640 10 monclient: _renew_subs 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a437fe640 4 set_mon_vals no callback set 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a533ec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.749+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a4c1d6e10 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f7a48011740 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a533ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a4c13f130 con 0x7f7a4c140740 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 3847258284 0 0) 0x7f7a4804e4f0 con 0x7f7a4c0a72f0 2024-09-11T01:58:36.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a51989640 10 monclient: get_auth_request con 0x7f7a3003fe10 auth_method 0 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983229008 0 0) 0x7f7a4c13f130 con 0x7f7a4c140740 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a41ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a41ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a41ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a41ffb640 10 monclient(hunting): my global_id is 4435 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.750+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a4c13cdb0 con 0x7f7a4c140740 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1879270890 0 0) 0x7f7a4c13cdb0 con 0x7f7a4c140740 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a4c13f130 con 0x7f7a4c140740 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7a3c001410 con 0x7f7a4c140740 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 10 monclient: dump: 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.779 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.780 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2521492368 0 0) 0x7f7a4c13f130 con 0x7f7a4c140740 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a4c0a5180 con 0x7f7a4c140740 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7a3c0016e0 con 0x7f7a4c140740 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 >> v1:172.21.15.203:6792/0 conn(0x7f7a4c140740 legacy=0x7f7a4c140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.751+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 >> v1:172.21.15.203:6792/0 conn(0x7f7a4c140740 legacy=0x7f7a4c140b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.757+0000 7f7a533ec640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.757+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a4c0694b0 con 0x7f7a4c141230 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621457418 0 0) 0x7f7a4c0694b0 con 0x7f7a4c141230 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:58:36.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 10 monclient(hunting): my global_id is 4444 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a4c13f130 con 0x7f7a4c141230 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1398372793 0 0) 0x7f7a4c13f130 con 0x7f7a4c141230 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a4c0694b0 con 0x7f7a4c141230 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7a3c005000 con 0x7f7a4c141230 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 10 monclient: dump: 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.782 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:36.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 834638785 0 0) 0x7f7a4c0694b0 con 0x7f7a4c141230 2024-09-11T01:58:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.758+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 --> v1:172.21.15.203:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a4c141610 con 0x7f7a4c141230 2024-09-11T01:58:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 30345032) 0x7f7a3c005130 con 0x7f7a4c141230 2024-09-11T01:58:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a41ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:58:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a41ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 >> v1:172.21.15.203:6792/0 conn(0x7f7a4c141230 legacy=0x7f7a4c1db000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a41ffb640 1 -- 172.21.15.73:0/1852808411 >> v1:172.21.15.203:6792/0 conn(0x7f7a4c141230 legacy=0x7f7a4c1db000 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:58:36.784 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:58:36.784 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 8, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 39179, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T01:58:36.785 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 28, 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.787 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.788 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.788 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.788 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.788 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.788 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.788 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:58:36.789 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:58:36.790 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:58:36.790 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:58:36.790 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:58:36.790 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:58:36.790 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:58:36.790 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:58:36.790 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.791 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.794 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:58:36.796 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.797 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.799 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.799 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.799 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:58:36.799 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.799 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.799 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.800 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:58:36.800 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:58:36.800 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.800 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.801 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:58:36.801 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.801 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.801 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.801 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.801 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.802 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:58:36.803 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.804 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.806 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:58:36.807 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:58:36.808 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:58:36.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 >> v1:172.21.15.203:6812/2311533528 conn(0x7f7a3003fe10 legacy=0x7f7a300422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a533ec640 10 monclient: shutdown 2024-09-11T01:58:36.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a533ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:36.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 >> v1:172.21.15.73:6789/0 conn(0x7f7a4c0a72f0 legacy=0x7f7a4c1399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:36.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a51989640 1 -- 172.21.15.73:0/1852808411 reap_dead start 2024-09-11T01:58:36.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a51989640 1 -- 172.21.15.73:0/1852808411 reap_dead start 2024-09-11T01:58:36.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 shutdown_connections 2024-09-11T01:58:36.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 >> 172.21.15.73:0/1852808411 conn(0x7f7a4c0a8050 msgr2=0x7f7a4c0a5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:36.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 shutdown_connections 2024-09-11T01:58:36.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:36.759+0000 7f7a533ec640 1 -- 172.21.15.73:0/1852808411 wait complete. 2024-09-11T01:58:36.810 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T01:58:36.811 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e', 'd'] 2024-09-11T01:58:36.811 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c', 'h', 'i'] 2024-09-11T01:58:36.811 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-09-11T01:58:36.811 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-09-11T01:58:36.811 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-09-11T01:58:36.811 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:58:36.821 INFO:tasks.ceph.mon.e:Stopped 2024-09-11T01:58:36.821 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-09-11T01:58:36.821 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-09-11T01:58:36.822 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-09-11T01:58:36.822 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:58:36.873 INFO:tasks.ceph.mon.d:Stopped 2024-09-11T01:58:36.873 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-11T01:58:36.873 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-11T01:58:36.873 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-09-11T01:58:36.874 INFO:tasks.ceph.mon.h:Sent signal 19 2024-09-11T01:58:36.874 INFO:tasks.mon_thrash:Sending STOP to mon i 2024-09-11T01:58:36.874 INFO:tasks.ceph.mon.i:Sent signal 19 2024-09-11T01:58:36.874 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T01:58:51.875 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-11T01:58:51.876 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-11T01:58:51.876 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-09-11T01:58:51.876 INFO:tasks.ceph.mon.h:Sent signal 18 2024-09-11T01:58:51.877 INFO:tasks.mon_thrash:Sending CONT to mon i 2024-09-11T01:58:51.877 INFO:tasks.ceph.mon.i:Sent signal 18 2024-09-11T01:58:51.877 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-09-11T01:58:51.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.983+0000 7fac727ad640 10 monclient: get_monmap_and_config 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.983+0000 7fac727ad640 10 monclient: build_initial_monmap 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.983+0000 7fac727ad640 10 monclient: monmap: 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:51.985397+0000 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:51.985397+0000 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:51.986 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:51.987 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:51.987 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:51.987 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:51.987 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:51.987 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:51.987 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:51.987 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:51.987 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:51.987 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac727ad640 1 Processor -- start 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac727ad640 1 -- start start 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac727ad640 10 monclient: init 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac727ad640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac727ad640 10 monclient: _add_conns ranks=[6,2,0,3,1,4,5,8,7] 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac727ad640 10 monclient(hunting): picked mon.noname-d con 0x7fac6c138d40 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac727ad640 10 monclient(hunting): picked mon.noname-b con 0x7fac6c0a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac727ad640 10 monclient(hunting): picked mon.noname-a con 0x7fac6c13f350 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac727ad640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c09ca00 con 0x7fac6c13f350 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.985+0000 7fac727ad640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c0a7070 con 0x7fac6c0a72f0 2024-09-11T01:58:51.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.985+0000 7fac727ad640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c09cee0 con 0x7fac6c138d40 2024-09-11T01:58:51.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.985+0000 7fac727ad640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:51.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.984+0000 7fac6bfff640 1 -- >> v1:172.21.15.73:6792/0 conn(0x7fac6c138d40 legacy=0x7fac6c139120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6792/0 2024-09-11T01:58:51.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.985+0000 7fac727ad640 10 monclient(hunting): authenticate will time out at 773.590043s 2024-09-11T01:58:51.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.985+0000 7fac6b7fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fac6c0a72f0 0x7fac6c13dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:58360/0 (socket says 172.21.15.73:58360) 2024-09-11T01:58:51.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.985+0000 7fac70d4a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fac6c13f350 0x7fac6c141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50066/0 (socket says 172.21.15.73:50066) 2024-09-11T01:58:51.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:51.985+0000 7fac6b7fe640 1 -- 172.21.15.73:0/2231631867 learned_addr learned my addr 172.21.15.73:0/2231631867 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:52.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:52.186+0000 7fac6bfff640 1 -- 172.21.15.73:0/2231631867 >> v1:172.21.15.73:6792/0 conn(0x7fac6c138d40 legacy=0x7fac6c139120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6792/0 2024-09-11T01:58:52.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:52.588+0000 7fac6bfff640 1 -- 172.21.15.73:0/2231631867 >> v1:172.21.15.73:6792/0 conn(0x7fac6c138d40 legacy=0x7fac6c139120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6792/0 2024-09-11T01:58:53.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:53.390+0000 7fac6bfff640 1 -- 172.21.15.73:0/2231631867 >> v1:172.21.15.73:6792/0 conn(0x7fac6c138d40 legacy=0x7fac6c139120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6792/0 2024-09-11T01:58:54.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 10 monclient(hunting): tick 2024-09-11T01:58:54.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 10 monclient(hunting): _check_auth_tickets 2024-09-11T01:58:54.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 1 monclient(hunting): continuing hunt 2024-09-11T01:58:54.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 10 monclient(hunting): _reopen_session rank -1 2024-09-11T01:58:54.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 1 -- 172.21.15.73:0/2231631867 >> v1:172.21.15.73:6792/0 conn(0x7fac6c138d40 legacy=0x7fac6c139120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:58:54.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 1 -- 172.21.15.73:0/2231631867 >> v1:172.21.15.73:6790/0 conn(0x7fac6c0a72f0 legacy=0x7fac6c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:54.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 1 -- 172.21.15.73:0/2231631867 >> v1:172.21.15.73:6789/0 conn(0x7fac6c13f350 legacy=0x7fac6c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:54.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 10 monclient: _add_conns ranks=[1,5,7,4,3,8] 2024-09-11T01:58:54.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 10 monclient(hunting): picked mon.noname-f con 0x7fac580037c0 addr v1:172.21.15.203:6789/0 2024-09-11T01:58:54.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 10 monclient(hunting): picked mon.noname-h con 0x7fac58007450 addr v1:172.21.15.203:6791/0 2024-09-11T01:58:54.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 10 monclient(hunting): picked mon.noname-i con 0x7fac5800b1e0 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:54.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 1 -- 172.21.15.73:0/2231631867 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c09d1c0 con 0x7fac580037c0 2024-09-11T01:58:54.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 1 -- 172.21.15.73:0/2231631867 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c09cee0 con 0x7fac58007450 2024-09-11T01:58:54.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 1 -- 172.21.15.73:0/2231631867 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac58011010 con 0x7fac5800b1e0 2024-09-11T01:58:54.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:54.986+0000 7fac69ffb640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060025668 0 0) 0x7fac58011010 con 0x7fac5800b1e0 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): my global_id is 4453 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac54003520 con 0x7fac5800b1e0 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2315894349 0 0) 0x7fac6c09cee0 con 0x7fac58007450 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): my global_id is 4523 2024-09-11T01:58:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac540048e0 con 0x7fac58007450 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901524992 0 0) 0x7fac6c09d1c0 con 0x7fac580037c0 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): _negotiate 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient(hunting): my global_id is 4465 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac6c09cee0 con 0x7fac580037c0 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 444057610 0 0) 0x7fac540048e0 con 0x7fac58007450 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 >> v1:172.21.15.203:6792/0 conn(0x7fac5800b1e0 legacy=0x7fac5800d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 >> v1:172.21.15.203:6789/0 conn(0x7fac580037c0 legacy=0x7fac58005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: _finish_hunting 0 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 monclient: found mon.noname-h 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac70d4a640 1 -- 172.21.15.73:0/2231631867 reap_dead start 2024-09-11T01:58:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.203:6791/0 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac58012370 con 0x7fac58007450 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: _finish_auth 0 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: _check_auth_tickets 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac60001770 con 0x7fac58007450 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac727ad640 5 monclient: authenticate success, global_id 4523 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T01:58:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: dump: 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac727ad640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 <== mon.5 v1:172.21.15.203:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac60001910 con 0x7fac58007450 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 1 -- 172.21.15.73:0/2231631867 <== mon.5 v1:172.21.15.203:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac60004be0 con 0x7fac58007450 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac727ad640 10 monclient: get_monmap_and_config success 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac727ad640 4 set_mon_vals no callback set 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.031+0000 7fac6affd640 10 monclient: dump: 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:56.041 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.033+0000 7fac727ad640 10 monclient: shutdown 2024-09-11T01:58:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.033+0000 7fac727ad640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.033+0000 7fac727ad640 1 -- 172.21.15.73:0/2231631867 >> v1:172.21.15.203:6791/0 conn(0x7fac58007450 legacy=0x7fac58009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.033+0000 7fac727ad640 1 -- 172.21.15.73:0/2231631867 shutdown_connections 2024-09-11T01:58:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.033+0000 7fac727ad640 1 -- 172.21.15.73:0/2231631867 >> 172.21.15.73:0/2231631867 conn(0x7fac6c0a8050 msgr2=0x7fac6c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.033+0000 7fac727ad640 1 -- 172.21.15.73:0/2231631867 shutdown_connections 2024-09-11T01:58:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.033+0000 7fac727ad640 1 -- 172.21.15.73:0/2231631867 wait complete. 2024-09-11T01:58:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.034+0000 7fac727ad640 10 monclient: build_initial_monmap 2024-09-11T01:58:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.034+0000 7fac727ad640 10 monclient: monmap: 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.035+0000 7fac727ad640 1 Processor -- start 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.035+0000 7fac727ad640 1 -- start start 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.035+0000 7fac727ad640 10 monclient: init 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 10 monclient: _add_conns ranks=[8,7,6,0,4,1,5,3,2] 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 10 monclient(hunting): picked mon.noname-e con 0x7fac58007450 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 10 monclient(hunting): picked mon.noname-i con 0x7fac6c1cd750 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 10 monclient(hunting): picked mon.noname-d con 0x7fac6c1d4190 addr v1:172.21.15.73:6792/0 2024-09-11T01:58:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c0aaa20 con 0x7fac6c1d4190 2024-09-11T01:58:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c0aa4f0 con 0x7fac6c1cd750 2024-09-11T01:58:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac6bfff640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7fac58007450 legacy=0x7fac6c137c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:58:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c121ed0 con 0x7fac58007450 2024-09-11T01:58:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac727ad640 10 monclient(hunting): authenticate will time out at 777.640360s 2024-09-11T01:58:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac70d4a640 1 -- >> v1:172.21.15.73:6792/0 conn(0x7fac6c1d4190 legacy=0x7fac6c1d6580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6792/0 2024-09-11T01:58:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac6b7fe640 1 --1- >> v1:172.21.15.203:6792/0 conn(0x7fac6c1cd750 0x7fac6c1d2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6792/0 says I am v1:172.21.15.73:51402/0 (socket says 172.21.15.73:51402) 2024-09-11T01:58:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.036+0000 7fac6b7fe640 1 -- 172.21.15.73:0/658770735 learned_addr learned my addr 172.21.15.73:0/658770735 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 397837917 0 0) 0x7fac6c0aa4f0 con 0x7fac6c1cd750 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient(hunting): my global_id is 4462 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac58010640 con 0x7fac6c1cd750 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1552300389 0 0) 0x7fac58010640 con 0x7fac6c1cd750 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac6c0aa4f0 con 0x7fac6c1cd750 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac60001bc0 con 0x7fac6c1cd750 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-11T01:58:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient(hunting): dump: 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3197015719 0 0) 0x7fac6c0aa4f0 con 0x7fac6c1cd750 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 >> v1:172.21.15.73:6793/0 conn(0x7fac58007450 legacy=0x7fac6c137c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 >> v1:172.21.15.73:6792/0 conn(0x7fac6c1d4190 legacy=0x7fac6c1d6580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient: _finish_hunting 0 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 monclient: found mon.i 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T01:58:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 --> v1:172.21.15.203:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6c13e160 con 0x7fac6c1cd750 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient: _finish_auth 0 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 10 monclient: _check_auth_tickets 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac727ad640 5 monclient: authenticate success, global_id 4462 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac727ad640 10 monclient: _renew_subs 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac727ad640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 --> v1:172.21.15.203:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fac6c1235c0 con 0x7fac6c1cd750 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac727ad640 10 monclient: _renew_subs 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac727ad640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.042+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 --> v1:172.21.15.203:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fac6c122200 con 0x7fac6c1cd750 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.043+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac60004dd0 con 0x7fac6c1cd750 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.043+0000 7fac68ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:58:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.043+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac600052c0 con 0x7fac6c1cd750 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.043+0000 7fac68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.043+0000 7fac68ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.043+0000 7fac6a7fc640 4 set_mon_vals no callback set 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.043+0000 7fac68ff9640 10 monclient: dump: 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:58:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.043+0000 7fac727ad640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.044+0000 7fac727ad640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.044+0000 7fac727ad640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.044+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 --> v1:172.21.15.203:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4c005080 con 0x7fac6c1cd750 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.044+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fac60011a00 con 0x7fac6c1cd750 2024-09-11T01:58:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.044+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 3847258284 0 0) 0x7fac6004e550 con 0x7fac6c1cd750 2024-09-11T01:58:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.044+0000 7fac6bfff640 10 monclient: get_auth_request con 0x7fac58041250 auth_method 0 2024-09-11T01:58:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.049+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fac6001b9d0 con 0x7fac6c1cd750 2024-09-11T01:58:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.049+0000 7fac68ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:58:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.049+0000 7fac68ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:58:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.296+0000 7fac727ad640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T01:58:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.296+0000 7fac727ad640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T01:58:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.296+0000 7fac727ad640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T01:58:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.296+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 --> v1:172.21.15.203:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fac4c005370 con 0x7fac6c1cd750 2024-09-11T01:58:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.297+0000 7fac68ff9640 1 -- 172.21.15.73:0/658770735 <== mon.7 v1:172.21.15.203:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2711 (unknown 254746657 0 1767128222) 0x7fac60020480 con 0x7fac6c1cd750 2024-09-11T01:58:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.297+0000 7fac68ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T01:58:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.297+0000 7fac68ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:58:56.299 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":14,"quorum":[0,1,2,3,5,7],"quorum_names":["a","f","b","g","h","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T01:58:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.299+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 >> v1:172.21.15.203:6812/2311533528 conn(0x7fac58041250 legacy=0x7fac58043710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.299+0000 7fac727ad640 10 monclient: shutdown 2024-09-11T01:58:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.299+0000 7fac727ad640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:58:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.299+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 >> v1:172.21.15.203:6792/0 conn(0x7fac6c1cd750 legacy=0x7fac6c1d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:58:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.299+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 shutdown_connections 2024-09-11T01:58:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.299+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 >> 172.21.15.73:0/658770735 conn(0x7fac6c0a8050 msgr2=0x7fac6c0a0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:58:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.299+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 shutdown_connections 2024-09-11T01:58:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:56.299+0000 7fac727ad640 1 -- 172.21.15.73:0/658770735 wait complete. 2024-09-11T01:58:59.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.419+0000 7f40c2a23640 10 monclient: get_monmap_and_config 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.419+0000 7f40c2a23640 10 monclient: build_initial_monmap 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.419+0000 7f40c2a23640 10 monclient: monmap: 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:58:59.420420+0000 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:58:59.420420+0000 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:58:59.421 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:58:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:58:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:58:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:58:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:58:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:58:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:58:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:58:59.422 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:58:59.422 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:58:59.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 1 Processor -- start 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 1 -- start start 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 10 monclient: init 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 10 monclient: _reopen_session rank -1 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 10 monclient: _add_conns ranks=[8,0,7,2,4,1,6,3,5] 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 10 monclient(hunting): picked mon.noname-e con 0x7f40bc0a5b30 addr v1:172.21.15.73:6793/0 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 10 monclient(hunting): picked mon.noname-a con 0x7f40bc0a6620 addr v1:172.21.15.73:6789/0 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 10 monclient(hunting): picked mon.noname-i con 0x7f40bc09db70 addr v1:172.21.15.203:6792/0 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40bc0a7490 con 0x7f40bc0a6620 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40bc09ca00 con 0x7f40bc09db70 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40bc06fbf0 con 0x7f40bc0a5b30 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 10 monclient(hunting): _renew_subs 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40c2a23640 10 monclient(hunting): authenticate will time out at 781.024921s 2024-09-11T01:58:59.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.420+0000 7f40bbfff640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7f40bc0a5b30 legacy=0x7f40bc0a5f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:58:59.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.421+0000 7f40bb7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f40bc0a6620 0x7f40bc13dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50068/0 (socket says 172.21.15.73:50068) 2024-09-11T01:58:59.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.421+0000 7f40bb7fe640 1 -- 172.21.15.73:0/903682773 learned_addr learned my addr 172.21.15.73:0/903682773 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:58:59.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:58:59.621+0000 7f40bbfff640 1 -- 172.21.15.73:0/903682773 >> v1:172.21.15.73:6793/0 conn(0x7f40bc0a5b30 legacy=0x7f40bc0a5f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:00.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:00.022+0000 7f40bbfff640 1 -- 172.21.15.73:0/903682773 >> v1:172.21.15.73:6793/0 conn(0x7f40bc0a5b30 legacy=0x7f40bc0a5f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:00.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:00.823+0000 7f40bbfff640 1 -- 172.21.15.73:0/903682773 >> v1:172.21.15.73:6793/0 conn(0x7f40bc0a5b30 legacy=0x7f40bc0a5f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:01.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.888+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679197722 0 0) 0x7f40bc0a7490 con 0x7f40bc0a6620 2024-09-11T01:59:01.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.888+0000 7f40baffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:01.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.888+0000 7f40baffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:01.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.888+0000 7f40baffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:01.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.888+0000 7f40baffd640 10 monclient(hunting): my global_id is 4590 2024-09-11T01:59:01.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.888+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40a4003520 con 0x7f40bc0a6620 2024-09-11T01:59:01.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855007955 0 0) 0x7f40bc09ca00 con 0x7f40bc09db70 2024-09-11T01:59:01.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:01.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient(hunting): my global_id is 4471 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40bc0a7490 con 0x7f40bc09db70 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1358344595 0 0) 0x7f40a4003520 con 0x7f40bc0a6620 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 >> v1:172.21.15.73:6793/0 conn(0x7f40bc0a5b30 legacy=0x7f40bc0a5f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 >> v1:172.21.15.203:6792/0 conn(0x7f40bc09db70 legacy=0x7f40bc141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: _finish_hunting 0 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 monclient: found mon.noname-a 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc09ceb0 con 0x7f40bc0a6620 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: _finish_auth 0 2024-09-11T01:59:01.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: _check_auth_tickets 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f40b0001790 con 0x7f40bc0a6620 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40c2a23640 5 monclient: authenticate success, global_id 4590 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: dump: 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:01.894 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40c2a23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f40b0001930 con 0x7f40bc0a6620 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 1 -- 172.21.15.73:0/903682773 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f40b0004be0 con 0x7f40bc0a6620 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40c2a23640 10 monclient: get_monmap_and_config success 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40c2a23640 4 set_mon_vals no callback set 2024-09-11T01:59:01.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.889+0000 7f40baffd640 10 monclient: dump: 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:01.896 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.890+0000 7f40c2a23640 10 monclient: shutdown 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.890+0000 7f40c2a23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.890+0000 7f40c2a23640 1 -- 172.21.15.73:0/903682773 >> v1:172.21.15.73:6789/0 conn(0x7f40bc0a6620 legacy=0x7f40bc13dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.890+0000 7f40c2a23640 1 -- 172.21.15.73:0/903682773 shutdown_connections 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.890+0000 7f40c2a23640 1 -- 172.21.15.73:0/903682773 >> 172.21.15.73:0/903682773 conn(0x7f40bc0abe30 msgr2=0x7f40bc0a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.890+0000 7f40c2a23640 1 -- 172.21.15.73:0/903682773 shutdown_connections 2024-09-11T01:59:01.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.890+0000 7f40c2a23640 1 -- 172.21.15.73:0/903682773 wait complete. 2024-09-11T01:59:01.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.891+0000 7f40c2a23640 10 monclient: build_initial_monmap 2024-09-11T01:59:01.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.891+0000 7f40c2a23640 10 monclient: monmap: 2024-09-11T01:59:01.899 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:01.899 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:59:01.899 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:01.900 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.891+0000 7f40c2a23640 1 Processor -- start 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 1 -- start start 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 10 monclient: init 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 10 monclient: _add_conns ranks=[1,8,6,2,7,5,0,4,3] 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 10 monclient(hunting): picked mon.noname-f con 0x7f40bc0a5b30 addr v1:172.21.15.203:6789/0 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 10 monclient(hunting): picked mon.noname-e con 0x7f40bc0a6620 addr v1:172.21.15.73:6793/0 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40bb7fe640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7f40bc0a6620 legacy=0x7f40bc1d2330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 10 monclient(hunting): picked mon.noname-d con 0x7f40bc127450 addr v1:172.21.15.73:6792/0 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40bc06e9b0 con 0x7f40bc0a5b30 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40bc1268f0 con 0x7f40bc127450 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40bc128c50 con 0x7f40bc0a6620 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:01.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c0fc0640 1 -- >> v1:172.21.15.73:6792/0 conn(0x7f40bc127450 legacy=0x7f40bc1d5a60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6792/0 2024-09-11T01:59:01.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40c2a23640 10 monclient(hunting): authenticate will time out at 783.496886s 2024-09-11T01:59:01.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40bbfff640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f40bc0a5b30 0x7f40bc1411f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.73:38210/0 (socket says 172.21.15.73:38210) 2024-09-11T01:59:01.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.892+0000 7f40bbfff640 1 -- 172.21.15.73:0/164796743 learned_addr learned my addr 172.21.15.73:0/164796743 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:01.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.901+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617379528 0 0) 0x7f40bc06e9b0 con 0x7f40bc0a5b30 2024-09-11T01:59:01.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.901+0000 7f40b8ff9640 10 monclient(hunting): _negotiate 2024-09-11T01:59:01.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.901+0000 7f40b8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:01.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.901+0000 7f40b8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:01.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.901+0000 7f40b8ff9640 10 monclient(hunting): my global_id is 4474 2024-09-11T01:59:01.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.901+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40a8003520 con 0x7f40bc0a5b30 2024-09-11T01:59:01.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1181361986 0 0) 0x7f40a8003520 con 0x7f40bc0a5b30 2024-09-11T01:59:01.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40bc06e9b0 con 0x7f40bc0a5b30 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f40ac004530 con 0x7f40bc0a5b30 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient(hunting): dump: 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:01.906 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 510128395 0 0) 0x7f40bc06e9b0 con 0x7f40bc0a5b30 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 >> v1:172.21.15.73:6793/0 conn(0x7f40bc0a6620 legacy=0x7f40bc1d2330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 >> v1:172.21.15.73:6792/0 conn(0x7f40bc127450 legacy=0x7f40bc1d5a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient: _finish_hunting 0 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 monclient: found mon.f 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc1283b0 con 0x7f40bc0a5b30 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient: _finish_auth 0 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient: _check_auth_tickets 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40c2a23640 5 monclient: authenticate success, global_id 4474 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40c2a23640 10 monclient: _renew_subs 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40c2a23640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 --> v1:172.21.15.203:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc141900 con 0x7f40bc0a5b30 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40c2a23640 10 monclient: _renew_subs 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40c2a23640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 --> v1:172.21.15.203:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f40bc1ca170 con 0x7f40bc0a5b30 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f40ac004790 con 0x7f40bc0a5b30 2024-09-11T01:59:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f40ac004d40 con 0x7f40bc0a5b30 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40b8ff9640 10 monclient: dump: 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:01.909 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.902+0000 7f40ba7fc640 4 set_mon_vals no callback set 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.903+0000 7f40c2a23640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.903+0000 7f40c2a23640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.903+0000 7f40c2a23640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.903+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f40ac004f80 con 0x7f40bc0a5b30 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.903+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 --> v1:172.21.15.203:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40bc0008d0 con 0x7f40bc0a5b30 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.903+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 3847258284 0 0) 0x7f40ac04e7b0 con 0x7f40bc0a5b30 2024-09-11T01:59:01.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.904+0000 7f40bb7fe640 10 monclient: get_auth_request con 0x7f40a803faf0 auth_method 0 2024-09-11T01:59:01.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.908+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f40ac0178b0 con 0x7f40bc0a5b30 2024-09-11T01:59:01.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.908+0000 7f40b8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:01.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:01.908+0000 7f40b8ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:59:02.036 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[34904]: starting. 2024-09-11T01:59:02.037 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[34904]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-34903 2024-09-11T01:59:02.037 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[34904]: created object 0... 2024-09-11T01:59:02.037 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[34904]: created object 25... 2024-09-11T01:59:02.037 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[34904]: created object 49... 2024-09-11T01:59:02.037 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[34904]: finishing. 2024-09-11T01:59:02.037 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[34904]: shutting down. 2024-09-11T01:59:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.175+0000 7f40c2a23640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T01:59:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.175+0000 7f40c2a23640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T01:59:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.175+0000 7f40c2a23640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T01:59:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.175+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 --> v1:172.21.15.203:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f40bc0abe30 con 0x7f40bc0a5b30 2024-09-11T01:59:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.175+0000 7f40b8ff9640 1 -- 172.21.15.73:0/164796743 <== mon.1 v1:172.21.15.203:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2717 (unknown 254746657 0 1212644902) 0x7f40ac0171b0 con 0x7f40bc0a5b30 2024-09-11T01:59:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.175+0000 7f40b8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T01:59:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.175+0000 7f40b8ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:59:02.177 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":18,"quorum":[0,1,2,3,4,5,7],"quorum_names":["a","f","b","g","c","h","i"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T01:59:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.177+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 >> v1:172.21.15.203:6812/2311533528 conn(0x7f40a803faf0 legacy=0x7f40a8041fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.177+0000 7f40c2a23640 10 monclient: shutdown 2024-09-11T01:59:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.177+0000 7f40c2a23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.177+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 >> v1:172.21.15.203:6789/0 conn(0x7f40bc0a5b30 legacy=0x7f40bc1411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.177+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 shutdown_connections 2024-09-11T01:59:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.177+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 >> 172.21.15.73:0/164796743 conn(0x7f40bc09db70 msgr2=0x7f40bc1422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.177+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 shutdown_connections 2024-09-11T01:59:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.177+0000 7f40c2a23640 1 -- 172.21.15.73:0/164796743 wait complete. 2024-09-11T01:59:02.190 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-09-11T01:59:02.190 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon a 2024-09-11T01:59:02.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.287+0000 7f2b086a9640 10 monclient: get_monmap_and_config 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.287+0000 7f2b086a9640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.287+0000 7f2b086a9640 10 monclient: monmap: 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:59:02.287925+0000 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:59:02.287925+0000 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.289 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.287+0000 7f2b086a9640 1 Processor -- start 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.287+0000 7f2b086a9640 1 -- start start 2024-09-11T01:59:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.287+0000 7f2b086a9640 10 monclient: init 2024-09-11T01:59:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 10 monclient: _add_conns ranks=[8,4,3,0,7,5,2,1,6] 2024-09-11T01:59:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 10 monclient(hunting): picked mon.noname-e con 0x7f2b00138960 addr v1:172.21.15.73:6793/0 2024-09-11T01:59:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 10 monclient(hunting): picked mon.noname-c con 0x7f2b00139450 addr v1:172.21.15.73:6791/0 2024-09-11T01:59:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 10 monclient(hunting): picked mon.noname-g con 0x7f2b0013f620 addr v1:172.21.15.203:6790/0 2024-09-11T01:59:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b0009d030 con 0x7f2b0013f620 2024-09-11T01:59:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b0009d310 con 0x7f2b00139450 2024-09-11T01:59:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b0006f770 con 0x7f2b00138960 2024-09-11T01:59:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 10 monclient(hunting): authenticate will time out at 783.892416s 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b06445640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7f2b00138960 legacy=0x7f2b00138d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05c44640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f2b00139450 0x7f2b0013df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43870/0 (socket says 172.21.15.73:43870) 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05c44640 1 -- 172.21.15.73:0/1297780237 learned_addr learned my addr 172.21.15.73:0/1297780237 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 1 -- 172.21.15.73:0/1297780237 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2989294260 0 0) 0x7f2b0009d310 con 0x7f2b00139450 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient(hunting): my global_id is 4477 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 1 -- 172.21.15.73:0/1297780237 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2aec003520 con 0x7f2b00139450 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 1 -- 172.21.15.73:0/1297780237 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2126787629 0 0) 0x7f2aec003520 con 0x7f2b00139450 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 1 -- 172.21.15.73:0/1297780237 >> v1:172.21.15.73:6793/0 conn(0x7f2b00138960 legacy=0x7f2b00138d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:59:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 1 -- 172.21.15.73:0/1297780237 >> v1:172.21.15.203:6790/0 conn(0x7f2b0013f620 legacy=0x7f2b00141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 1 monclient: found mon.noname-c 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 1 -- 172.21.15.73:0/1297780237 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b000a7360 con 0x7f2b00139450 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 1 -- 172.21.15.73:0/1297780237 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2af0001830 con 0x7f2b00139450 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 5 monclient: authenticate success, global_id 4477 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b086a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:59:02.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.288+0000 7f2b05443640 10 monclient: dump: 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b05443640 1 -- 172.21.15.73:0/1297780237 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2af0001a50 con 0x7f2b00139450 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b05443640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b05443640 1 -- 172.21.15.73:0/1297780237 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2af0001d40 con 0x7f2b00139450 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 10 monclient: get_monmap_and_config success 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 4 set_mon_vals no callback set 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b05443640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b05443640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b05443640 10 monclient: dump: 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.304 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 10 monclient: shutdown 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 1 -- 172.21.15.73:0/1297780237 >> v1:172.21.15.73:6791/0 conn(0x7f2b00139450 legacy=0x7f2b0013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 1 -- 172.21.15.73:0/1297780237 shutdown_connections 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 1 -- 172.21.15.73:0/1297780237 >> 172.21.15.73:0/1297780237 conn(0x7f2b000a8050 msgr2=0x7f2b000a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 1 -- 172.21.15.73:0/1297780237 shutdown_connections 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.289+0000 7f2b086a9640 1 -- 172.21.15.73:0/1297780237 wait complete. 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient: monmap: 2024-09-11T01:59:02.305 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 1 Processor -- start 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 1 -- start start 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient: init 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient: _add_conns ranks=[5,8,2,4,3,6,7,0,1] 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient(hunting): picked mon.noname-h con 0x7f2b00138960 addr v1:172.21.15.203:6791/0 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient(hunting): picked mon.noname-e con 0x7f2b00139450 addr v1:172.21.15.73:6793/0 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient(hunting): picked mon.noname-b con 0x7f2b0013f620 addr v1:172.21.15.73:6790/0 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b00142b50 con 0x7f2b0013f620 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b00142490 con 0x7f2b00138960 2024-09-11T01:59:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b0013d340 con 0x7f2b00139450 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.290+0000 7f2b086a9640 10 monclient(hunting): authenticate will time out at 783.894997s 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b05c44640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7f2b00139450 legacy=0x7f2b001d25c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b06c46640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f2b0013f620 0x7f2b001d5cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:39706/0 (socket says 172.21.15.73:39706) 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b06c46640 1 -- 172.21.15.73:0/1222059429 learned_addr learned my addr 172.21.15.73:0/1222059429 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990782608 0 0) 0x7f2b00142b50 con 0x7f2b0013f620 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): my global_id is 4529 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ae4003520 con 0x7f2b0013f620 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669582046 0 0) 0x7f2b00142490 con 0x7f2b00138960 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): my global_id is 4532 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b00142b50 con 0x7f2b00138960 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2905160774 0 0) 0x7f2ae4003520 con 0x7f2b0013f620 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b00142490 con 0x7f2b0013f620 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2af8001ab0 con 0x7f2b0013f620 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): dump: 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2350468969 0 0) 0x7f2b00142b50 con 0x7f2b00138960 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ae4003520 con 0x7f2b00138960 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2afc004620 con 0x7f2b00138960 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient(hunting): dump: 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2228333794 0 0) 0x7f2b00142490 con 0x7f2b0013f620 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 >> v1:172.21.15.73:6793/0 conn(0x7f2b00139450 legacy=0x7f2b001d25c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 >> v1:172.21.15.203:6791/0 conn(0x7f2b00138960 legacy=0x7f2b00137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 monclient: found mon.b 2024-09-11T01:59:02.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0013c680 con 0x7f2b0013f620 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b086a9640 5 monclient: authenticate success, global_id 4529 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b086a9640 10 monclient: _renew_subs 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b086a9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b00141dc0 con 0x7f2b0013f620 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b086a9640 10 monclient: _renew_subs 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b086a9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b0013b340 con 0x7f2b0013f620 2024-09-11T01:59:02.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2af80038c0 con 0x7f2b0013f620 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2af8003eb0 con 0x7f2b0013f620 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2b04c42640 4 set_mon_vals no callback set 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.291+0000 7f2af6ffd640 10 monclient: dump: 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.314 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.292+0000 7f2b086a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.292+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ae80065c0 con 0x7f2ae8002860 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.292+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f2af80040d0 con 0x7f2b0013f620 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.292+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 206582418 0 0) 0x7f2af804e370 con 0x7f2b0013f620 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924427883 0 0) 0x7f2ae80065c0 con 0x7f2ae8002860 2024-09-11T01:59:02.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 10 monclient(hunting): my global_id is 4599 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b00142490 con 0x7f2ae8002860 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2b05c44640 10 monclient: get_auth_request con 0x7f2ae4040230 auth_method 0 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 585310207 0 0) 0x7f2b00142490 con 0x7f2ae8002860 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ae80065c0 con 0x7f2ae8002860 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2afc004e80 con 0x7f2ae8002860 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 10 monclient: dump: 2024-09-11T01:59:02.316 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.317 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.318 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 979197954 0 0) 0x7f2ae80065c0 con 0x7f2ae8002860 2024-09-11T01:59:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ae800a160 con 0x7f2ae8002860 2024-09-11T01:59:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2afc0071e0 con 0x7f2ae8002860 2024-09-11T01:59:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:59:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 >> v1:172.21.15.73:6789/0 conn(0x7f2ae8002860 legacy=0x7f2ae8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.293+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 >> v1:172.21.15.73:6789/0 conn(0x7f2ae8002860 legacy=0x7f2ae8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.299+0000 7f2b086a9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.299+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ae8009e50 con 0x7f2ae8009110 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1139997676 0 0) 0x7f2ae8009e50 con 0x7f2ae8009110 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 10 monclient(hunting): my global_id is 4608 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ae80065c0 con 0x7f2ae8009110 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2619142138 0 0) 0x7f2ae80065c0 con 0x7f2ae8009110 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ae8009e50 con 0x7f2ae8009110 2024-09-11T01:59:02.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2afc0057d0 con 0x7f2ae8009110 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 10 monclient: dump: 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3777204652 0 0) 0x7f2ae8009e50 con 0x7f2ae8009110 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 --> v1:172.21.15.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2ae800c3f0 con 0x7f2ae8009110 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7688 (unknown 0 0 2825282813) 0x7f2afc00a1d0 con 0x7f2ae8009110 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 >> v1:172.21.15.73:6789/0 conn(0x7f2ae8009110 legacy=0x7f2ae80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2af6ffd640 1 -- 172.21.15.73:0/1222059429 >> v1:172.21.15.73:6789/0 conn(0x7f2ae8009110 legacy=0x7f2ae80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 18, 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 64740, 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:59:02.323 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: 7 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.324 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.325 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:59:02.326 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:59:02.328 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.329 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.330 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.331 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.332 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.334 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.335 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.336 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.337 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.338 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.339 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T01:59:02.341 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:59:02.342 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:59:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 >> v1:172.21.15.203:6812/2311533528 conn(0x7f2ae4040230 legacy=0x7f2ae40426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2b086a9640 10 monclient: shutdown 2024-09-11T01:59:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2b086a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 >> v1:172.21.15.73:6790/0 conn(0x7f2b0013f620 legacy=0x7f2b001d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.300+0000 7f2b06c46640 1 -- 172.21.15.73:0/1222059429 reap_dead start 2024-09-11T01:59:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.301+0000 7f2b06c46640 1 -- 172.21.15.73:0/1222059429 reap_dead start 2024-09-11T01:59:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.301+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 shutdown_connections 2024-09-11T01:59:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.301+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 >> 172.21.15.73:0/1222059429 conn(0x7f2b000a8050 msgr2=0x7f2b000a8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.301+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 shutdown_connections 2024-09-11T01:59:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.301+0000 7f2b086a9640 1 -- 172.21.15.73:0/1222059429 wait complete. 2024-09-11T01:59:02.345 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T01:59:02.345 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon b 2024-09-11T01:59:02.345 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T01:59:02.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.442+0000 7fad2c079640 10 monclient: get_monmap_and_config 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.442+0000 7fad2c079640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.442+0000 7fad2c079640 10 monclient: monmap: 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:59:02.443014+0000 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:59:02.443014+0000 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.445 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.442+0000 7fad2c079640 1 Processor -- start 2024-09-11T01:59:02.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 1 -- start start 2024-09-11T01:59:02.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 10 monclient: init 2024-09-11T01:59:02.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 10 monclient: _add_conns ranks=[4,0,8,5,7,3,1,6,2] 2024-09-11T01:59:02.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 10 monclient(hunting): picked mon.noname-c con 0x7fad24138d40 addr v1:172.21.15.73:6791/0 2024-09-11T01:59:02.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 10 monclient(hunting): picked mon.noname-a con 0x7fad240a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T01:59:02.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 10 monclient(hunting): picked mon.noname-e con 0x7fad2413f350 addr v1:172.21.15.73:6793/0 2024-09-11T01:59:02.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2409ca00 con 0x7fad240a72f0 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad240a7070 con 0x7fad24138d40 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2409cee0 con 0x7fad2413f350 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2c079640 10 monclient(hunting): authenticate will time out at 784.047540s 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad2a616640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7fad2413f350 legacy=0x7fad24141740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad29e15640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fad24138d40 0x7fad24139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43876/0 (socket says 172.21.15.73:43876) 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad29e15640 1 -- 172.21.15.73:0/1796140063 learned_addr learned my addr 172.21.15.73:0/1796140063 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad29614640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fad240a72f0 0x7fad2413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47408/0 (socket says 172.21.15.73:47408) 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 787801585 0 0) 0x7fad240a7070 con 0x7fad24138d40 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 10 monclient(hunting): my global_id is 4486 2024-09-11T01:59:02.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad10003520 con 0x7fad24138d40 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819397356 0 0) 0x7fad2409ca00 con 0x7fad240a72f0 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 10 monclient(hunting): my global_id is 4617 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.443+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad240a7070 con 0x7fad240a72f0 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1868145385 0 0) 0x7fad240a7070 con 0x7fad240a72f0 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 >> v1:172.21.15.73:6793/0 conn(0x7fad2413f350 legacy=0x7fad24141740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 >> v1:172.21.15.73:6791/0 conn(0x7fad24138d40 legacy=0x7fad24139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 1 monclient: found mon.noname-a 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2409d1c0 con 0x7fad240a72f0 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 5 monclient: authenticate success, global_id 4617 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fad14001700 con 0x7fad240a72f0 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: dump: 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad14001920 con 0x7fad240a72f0 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 10 monclient: get_monmap_and_config success 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 1 -- 172.21.15.73:0/1796140063 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fad140047e0 con 0x7fad240a72f0 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 4 set_mon_vals no callback set 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad28e13640 10 monclient: dump: 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 10 monclient: shutdown 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 1 -- 172.21.15.73:0/1796140063 >> v1:172.21.15.73:6789/0 conn(0x7fad240a72f0 legacy=0x7fad2413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 1 -- 172.21.15.73:0/1796140063 shutdown_connections 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 1 -- 172.21.15.73:0/1796140063 >> 172.21.15.73:0/1796140063 conn(0x7fad240a8050 msgr2=0x7fad240a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 1 -- 172.21.15.73:0/1796140063 shutdown_connections 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.444+0000 7fad2c079640 1 -- 172.21.15.73:0/1796140063 wait complete. 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.445+0000 7fad2c079640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.445+0000 7fad2c079640 10 monclient: monmap: 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.445+0000 7fad2c079640 1 Processor -- start 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.445+0000 7fad2c079640 1 -- start start 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.445+0000 7fad2c079640 10 monclient: init 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient: _add_conns ranks=[1,3,0,5,8,4,7,6,2] 2024-09-11T01:59:02.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient(hunting): picked mon.noname-f con 0x7fad240a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient(hunting): picked mon.noname-g con 0x7fad24138d40 addr v1:172.21.15.203:6790/0 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient(hunting): picked mon.noname-a con 0x7fad2413f350 addr v1:172.21.15.73:6789/0 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad241428f0 con 0x7fad2413f350 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad24142420 con 0x7fad240a72f0 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2413c010 con 0x7fad24138d40 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient(hunting): authenticate will time out at 784.050168s 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2a616640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fad2413f350 0x7fad241d5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47420/0 (socket says 172.21.15.73:47420) 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2a616640 1 -- 172.21.15.73:0/927815519 learned_addr learned my addr 172.21.15.73:0/927815519 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2079187292 0 0) 0x7fad1c003d30 con 0x7fad2413f350 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): my global_id is 4626 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad08003520 con 0x7fad2413f350 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1673458037 0 0) 0x7fad08003520 con 0x7fad2413f350 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad1c003d30 con 0x7fad2413f350 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fad1c0047a0 con 0x7fad2413f350 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): dump: 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342520397 0 0) 0x7fad24142420 con 0x7fad240a72f0 2024-09-11T01:59:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): my global_id is 4483 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad08003520 con 0x7fad240a72f0 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982679159 0 0) 0x7fad2413c010 con 0x7fad24138d40 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient(hunting): my global_id is 4566 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad24142420 con 0x7fad24138d40 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1362842799 0 0) 0x7fad1c003d30 con 0x7fad2413f350 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 >> v1:172.21.15.203:6790/0 conn(0x7fad24138d40 legacy=0x7fad241d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 >> v1:172.21.15.203:6789/0 conn(0x7fad240a72f0 legacy=0x7fad2413e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 monclient: found mon.a 2024-09-11T01:59:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:59:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2413b0b0 con 0x7fad2413f350 2024-09-11T01:59:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 5 monclient: authenticate success, global_id 4626 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient: _renew_subs 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad24141be0 con 0x7fad2413f350 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient: _renew_subs 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fad2413e900 con 0x7fad2413f350 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad1c0049b0 con 0x7fad2413f350 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fad1c004fe0 con 0x7fad2413f350 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1bfff640 4 set_mon_vals no callback set 2024-09-11T01:59:02.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.446+0000 7fad1a7fc640 10 monclient: dump: 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.468 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.447+0000 7fad2c079640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.447+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad0c0065c0 con 0x7fad0c002860 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.447+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fad1c005180 con 0x7fad2413f350 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 447829997 0 0) 0x7fad0c0065c0 con 0x7fad0c002860 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 10 monclient(hunting): my global_id is 4538 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad1c003d30 con 0x7fad0c002860 2024-09-11T01:59:02.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 206582418 0 0) 0x7fad1c04e8b0 con 0x7fad2413f350 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad29614640 10 monclient: get_auth_request con 0x7fad0803fee0 auth_method 0 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2329798444 0 0) 0x7fad1c003d30 con 0x7fad0c002860 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad0c0065c0 con 0x7fad0c002860 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fad20001420 con 0x7fad0c002860 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 10 monclient: dump: 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 899899819 0 0) 0x7fad0c0065c0 con 0x7fad0c002860 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad0c00a160 con 0x7fad0c002860 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fad20001800 con 0x7fad0c002860 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:59:02.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 >> v1:172.21.15.73:6790/0 conn(0x7fad0c002860 legacy=0x7fad0c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.448+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 >> v1:172.21.15.73:6790/0 conn(0x7fad0c002860 legacy=0x7fad0c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.454+0000 7fad2c079640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:59:02.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.454+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad0c009e50 con 0x7fad0c009110 2024-09-11T01:59:02.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414846809 0 0) 0x7fad0c009e50 con 0x7fad0c009110 2024-09-11T01:59:02.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 10 monclient(hunting): my global_id is 4547 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad0c0065c0 con 0x7fad0c009110 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2334140641 0 0) 0x7fad0c0065c0 con 0x7fad0c009110 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad0c009e50 con 0x7fad0c009110 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fad20004da0 con 0x7fad0c009110 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 10 monclient: dump: 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.474 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3120925839 0 0) 0x7fad0c009e50 con 0x7fad0c009110 2024-09-11T01:59:02.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 --> v1:172.21.15.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fad0c00c3f0 con 0x7fad0c009110 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7690 (unknown 0 0 1759291144) 0x7fad20006210 con 0x7fad0c009110 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 >> v1:172.21.15.73:6790/0 conn(0x7fad0c009110 legacy=0x7fad0c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.455+0000 7fad1a7fc640 1 -- 172.21.15.73:0/927815519 >> v1:172.21.15.73:6790/0 conn(0x7fad0c009110 legacy=0x7fad0c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 18, 2024-09-11T01:59:02.476 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 64913, 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: 7 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:59:02.477 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:59:02.478 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:59:02.479 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:59:02.480 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.481 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.482 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.483 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:59:02.484 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.486 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:59:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:59:02.488 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.489 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:59:02.492 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.493 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.494 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:59:02.495 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 >> v1:172.21.15.203:6812/2311533528 conn(0x7fad0803fee0 legacy=0x7fad080423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2c079640 10 monclient: shutdown 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2c079640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 >> v1:172.21.15.73:6789/0 conn(0x7fad2413f350 legacy=0x7fad241d5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2a616640 1 -- 172.21.15.73:0/927815519 reap_dead start 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2a616640 1 -- 172.21.15.73:0/927815519 reap_dead start 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 shutdown_connections 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 >> 172.21.15.73:0/927815519 conn(0x7fad240a8050 msgr2=0x7fad240a63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 shutdown_connections 2024-09-11T01:59:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.456+0000 7fad2c079640 1 -- 172.21.15.73:0/927815519 wait complete. 2024-09-11T01:59:02.498 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T01:59:02.498 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon c 2024-09-11T01:59:02.498 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T01:59:02.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.598+0000 7f6ed062a640 10 monclient: get_monmap_and_config 2024-09-11T01:59:02.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.598+0000 7f6ed062a640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.598+0000 7f6ed062a640 10 monclient: monmap: 2024-09-11T01:59:02.600 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.600 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.600 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:59:02.599491+0000 2024-09-11T01:59:02.600 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:59:02.599491+0000 2024-09-11T01:59:02.600 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.600 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.601 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 1 Processor -- start 2024-09-11T01:59:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 1 -- start start 2024-09-11T01:59:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 10 monclient: init 2024-09-11T01:59:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 10 monclient: _add_conns ranks=[6,4,8,7,0,1,5,3,2] 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 10 monclient(hunting): picked mon.noname-d con 0x7f6ec8138d40 addr v1:172.21.15.73:6792/0 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 10 monclient(hunting): picked mon.noname-c con 0x7f6ec80a72f0 addr v1:172.21.15.73:6791/0 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 10 monclient(hunting): picked mon.noname-e con 0x7f6ec813f350 addr v1:172.21.15.73:6793/0 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec809ca00 con 0x7f6ec80a72f0 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec80a7070 con 0x7f6ec8138d40 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ece3c6640 1 -- >> v1:172.21.15.73:6792/0 conn(0x7f6ec8138d40 legacy=0x7f6ec8139120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6792/0 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.599+0000 7f6ed062a640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec809cee0 con 0x7f6ec813f350 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ed062a640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ed062a640 10 monclient(hunting): authenticate will time out at 784.204010s 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecebc7640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7f6ec813f350 legacy=0x7f6ec8141740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecdbc5640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f6ec80a72f0 0x7f6ec813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43884/0 (socket says 172.21.15.73:43884) 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecdbc5640 1 -- 172.21.15.73:0/2991292248 learned_addr learned my addr 172.21.15.73:0/2991292248 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 -- 172.21.15.73:0/2991292248 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311071642 0 0) 0x7f6ec809ca00 con 0x7f6ec80a72f0 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient(hunting): my global_id is 4495 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 -- 172.21.15.73:0/2991292248 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eb4003520 con 0x7f6ec80a72f0 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 -- 172.21.15.73:0/2991292248 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2872484222 0 0) 0x7f6eb4003520 con 0x7f6ec80a72f0 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 -- 172.21.15.73:0/2991292248 >> v1:172.21.15.73:6793/0 conn(0x7f6ec813f350 legacy=0x7f6ec8141740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 -- 172.21.15.73:0/2991292248 >> v1:172.21.15.73:6792/0 conn(0x7f6ec8138d40 legacy=0x7f6ec8139120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 monclient: found mon.noname-c 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T01:59:02.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 -- 172.21.15.73:0/2991292248 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec809d1c0 con 0x7f6ec80a72f0 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 -- 172.21.15.73:0/2991292248 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6eb8001850 con 0x7f6ec80a72f0 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ed062a640 5 monclient: authenticate success, global_id 4495 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ed062a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: dump: 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ed062a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 -- 172.21.15.73:0/2991292248 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6eb8001a70 con 0x7f6ec80a72f0 2024-09-11T01:59:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 1 -- 172.21.15.73:0/2991292248 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6eb8004be0 con 0x7f6ec80a72f0 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ed062a640 10 monclient: get_monmap_and_config success 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ed062a640 4 set_mon_vals no callback set 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.600+0000 7f6ecd3c4640 10 monclient: dump: 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.601+0000 7f6ed062a640 10 monclient: shutdown 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.601+0000 7f6ed062a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.601+0000 7f6ed062a640 1 -- 172.21.15.73:0/2991292248 >> v1:172.21.15.73:6791/0 conn(0x7f6ec80a72f0 legacy=0x7f6ec813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.601+0000 7f6ed062a640 1 -- 172.21.15.73:0/2991292248 shutdown_connections 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.601+0000 7f6ed062a640 1 -- 172.21.15.73:0/2991292248 >> 172.21.15.73:0/2991292248 conn(0x7f6ec80a8050 msgr2=0x7f6ec80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.601+0000 7f6ed062a640 1 -- 172.21.15.73:0/2991292248 shutdown_connections 2024-09-11T01:59:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.601+0000 7f6ed062a640 1 -- 172.21.15.73:0/2991292248 wait complete. 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.601+0000 7f6ed062a640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.601+0000 7f6ed062a640 10 monclient: monmap: 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 1 Processor -- start 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 1 -- start start 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 10 monclient: init 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 10 monclient: _add_conns ranks=[6,5,0,2,4,3,8,1,7] 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 10 monclient(hunting): picked mon.noname-d con 0x7f6ec80a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 10 monclient(hunting): picked mon.noname-h con 0x7f6ec8138d40 addr v1:172.21.15.203:6791/0 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 10 monclient(hunting): picked mon.noname-a con 0x7f6ec813f350 addr v1:172.21.15.73:6789/0 2024-09-11T01:59:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ece3c6640 1 -- >> v1:172.21.15.73:6792/0 conn(0x7f6ec80a72f0 legacy=0x7f6ec813de90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6792/0 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec81cd8f0 con 0x7f6ec813f350 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec80a1970 con 0x7f6ec8138d40 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec813c0c0 con 0x7f6ec80a72f0 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ed062a640 10 monclient(hunting): authenticate will time out at 784.206734s 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ecebc7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6ec813f350 0x7f6ec81d5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47434/0 (socket says 172.21.15.73:47434) 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ecebc7640 1 -- 172.21.15.73:0/3355935560 learned_addr learned my addr 172.21.15.73:0/3355935560 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811827058 0 0) 0x7f6ec81cd8f0 con 0x7f6ec813f350 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ebeffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ebeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ebeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ebeffd640 10 monclient(hunting): my global_id is 4635 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.602+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eac003520 con 0x7f6ec813f350 2024-09-11T01:59:02.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226208762 0 0) 0x7f6ec80a1970 con 0x7f6ec8138d40 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient(hunting): my global_id is 4541 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ec81cd8f0 con 0x7f6ec8138d40 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2518500760 0 0) 0x7f6eac003520 con 0x7f6ec813f350 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ec80a1970 con 0x7f6ec813f350 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6ec0004590 con 0x7f6ec813f350 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient(hunting): dump: 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.619 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.620 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2297041106 0 0) 0x7f6ec80a1970 con 0x7f6ec813f350 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 >> v1:172.21.15.73:6792/0 conn(0x7f6ec80a72f0 legacy=0x7f6ec813de90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 >> v1:172.21.15.203:6791/0 conn(0x7f6ec8138d40 legacy=0x7f6ec81d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 monclient: found mon.a 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec813c3a0 con 0x7f6ec813f350 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ed062a640 5 monclient: authenticate success, global_id 4635 2024-09-11T01:59:02.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ed062a640 10 monclient: _renew_subs 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ed062a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec813b160 con 0x7f6ec813f350 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ed062a640 10 monclient: _renew_subs 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ed062a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ec813e5a0 con 0x7f6ec813f350 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ec00047b0 con 0x7f6ec813f350 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6ec0004d20 con 0x7f6ec813f350 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6ebeffd640 10 monclient: dump: 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.622 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.603+0000 7f6eccbc3640 4 set_mon_vals no callback set 2024-09-11T01:59:02.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ed062a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6ec80008d0 con 0x7f6ec80a1000 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f6ec0004f60 con 0x7f6ec813f350 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 206582418 0 0) 0x7f6ec004e780 con 0x7f6ec813f350 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 976558891 0 0) 0x7f6ec80008d0 con 0x7f6ec80a1000 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 10 monclient(hunting): my global_id is 4504 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ec80a1970 con 0x7f6ec80a1000 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ecdbc5640 10 monclient: get_auth_request con 0x7f6eac03fcc0 auth_method 0 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3407000358 0 0) 0x7f6ec80a1970 con 0x7f6ec80a1000 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ec80008d0 con 0x7f6ec80a1000 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6ec4004100 con 0x7f6ec80a1000 2024-09-11T01:59:02.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 10 monclient: dump: 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.625 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.604+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3704714024 0 0) 0x7f6ec80008d0 con 0x7f6ec80a1000 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.605+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ec813c830 con 0x7f6ec80a1000 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.605+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6ec4006480 con 0x7f6ec80a1000 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.605+0000 7f6ebeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.605+0000 7f6ebeffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.605+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 >> v1:172.21.15.73:6791/0 conn(0x7f6ec80a1000 legacy=0x7f6ec8140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.605+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 >> v1:172.21.15.73:6791/0 conn(0x7f6ec80a1000 legacy=0x7f6ec8140740 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ed062a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6ec802e830 con 0x7f6ec802e450 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235908272 0 0) 0x7f6ec802e830 con 0x7f6ec802e450 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 10 monclient(hunting): my global_id is 4513 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ec80008d0 con 0x7f6ec802e450 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4272597085 0 0) 0x7f6ec80008d0 con 0x7f6ec802e450 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ec802e830 con 0x7f6ec802e450 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6ec4004ae0 con 0x7f6ec802e450 2024-09-11T01:59:02.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.611+0000 7f6ebeffd640 10 monclient: dump: 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1849022537 0 0) 0x7f6ec802e830 con 0x7f6ec802e450 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 --> v1:172.21.15.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6ec80a13e0 con 0x7f6ec802e450 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7521 (unknown 0 0 3137168757) 0x7f6ec4005fd0 con 0x7f6ec802e450 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ebeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ebeffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 >> v1:172.21.15.73:6791/0 conn(0x7f6ec802e450 legacy=0x7f6ec8140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ebeffd640 1 -- 172.21.15.73:0/3355935560 >> v1:172.21.15.73:6791/0 conn(0x7f6ec802e450 legacy=0x7f6ec8140e50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 18, 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 65075, 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:59:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: 7 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:59:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:59:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:59:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:59:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:59:02.650 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:59:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 >> v1:172.21.15.203:6812/2311533528 conn(0x7f6eac03fcc0 legacy=0x7f6eac042180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ed062a640 10 monclient: shutdown 2024-09-11T01:59:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ed062a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 >> v1:172.21.15.73:6789/0 conn(0x7f6ec813f350 legacy=0x7f6ec81d5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ecebc7640 1 -- 172.21.15.73:0/3355935560 reap_dead start 2024-09-11T01:59:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ecebc7640 1 -- 172.21.15.73:0/3355935560 reap_dead start 2024-09-11T01:59:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 shutdown_connections 2024-09-11T01:59:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 >> 172.21.15.73:0/3355935560 conn(0x7f6ec80a8050 msgr2=0x7f6ec80a9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 shutdown_connections 2024-09-11T01:59:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.612+0000 7f6ed062a640 1 -- 172.21.15.73:0/3355935560 wait complete. 2024-09-11T01:59:02.652 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T01:59:02.652 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon f 2024-09-11T01:59:02.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-11T01:59:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.748+0000 7f2967110640 10 monclient: get_monmap_and_config 2024-09-11T01:59:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.748+0000 7f2967110640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.748+0000 7f2967110640 10 monclient: monmap: 2024-09-11T01:59:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:59:02.749537+0000 2024-09-11T01:59:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:59:02.749537+0000 2024-09-11T01:59:02.750 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.751 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 1 Processor -- start 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 1 -- start start 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 10 monclient: init 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 10 monclient: _add_conns ranks=[8,7,5,4,1,2,3,0,6] 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 10 monclient(hunting): picked mon.noname-e con 0x7f29600a5b30 addr v1:172.21.15.73:6793/0 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 10 monclient(hunting): picked mon.noname-i con 0x7f29600a6620 addr v1:172.21.15.203:6792/0 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 10 monclient(hunting): picked mon.noname-h con 0x7f296009db70 addr v1:172.21.15.203:6791/0 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29600a7490 con 0x7f296009db70 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296009ca00 con 0x7f29600a6620 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296006fbf0 con 0x7f29600a5b30 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2967110640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.749+0000 7f2964eac640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7f29600a5b30 legacy=0x7f29600a5f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f2967110640 10 monclient(hunting): authenticate will time out at 784.354015s 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f29656ad640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7f296009db70 0x7f2960141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.73:48884/0 (socket says 172.21.15.73:48884) 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295ffff640 1 --1- >> v1:172.21.15.203:6792/0 conn(0x7f29600a6620 0x7f296013dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6792/0 says I am v1:172.21.15.73:48554/0 (socket says 172.21.15.73:48554) 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f29656ad640 1 -- 172.21.15.73:0/1245724020 learned_addr learned my addr 172.21.15.73:0/1245724020 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180253005 0 0) 0x7f296009ca00 con 0x7f29600a6620 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient(hunting): my global_id is 4480 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2948003520 con 0x7f29600a6620 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48732135 0 0) 0x7f29600a7490 con 0x7f296009db70 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient(hunting): my global_id is 4550 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f296009ca00 con 0x7f296009db70 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2549225578 0 0) 0x7f2948003520 con 0x7f29600a6620 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 >> v1:172.21.15.73:6793/0 conn(0x7f29600a5b30 legacy=0x7f29600a5f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 >> v1:172.21.15.203:6791/0 conn(0x7f296009db70 legacy=0x7f2960141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 monclient: found mon.noname-i 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.203:6792/0 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 --> v1:172.21.15.203:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296009ceb0 con 0x7f29600a6620 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f2967110640 5 monclient: authenticate success, global_id 4480 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2954001830 con 0x7f29600a6620 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: dump: 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.764 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f2967110640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 <== mon.7 v1:172.21.15.203:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2954001a50 con 0x7f29600a6620 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 1 -- 172.21.15.73:0/1245724020 <== mon.7 v1:172.21.15.203:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2954004b20 con 0x7f29600a6620 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f2967110640 10 monclient: get_monmap_and_config success 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f2967110640 4 set_mon_vals no callback set 2024-09-11T01:59:02.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.750+0000 7f295f7fe640 10 monclient: dump: 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.766 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.767 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.751+0000 7f2967110640 10 monclient: shutdown 2024-09-11T01:59:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.751+0000 7f2967110640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.751+0000 7f2967110640 1 -- 172.21.15.73:0/1245724020 >> v1:172.21.15.203:6792/0 conn(0x7f29600a6620 legacy=0x7f296013dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.751+0000 7f2967110640 1 -- 172.21.15.73:0/1245724020 shutdown_connections 2024-09-11T01:59:02.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.751+0000 7f2967110640 1 -- 172.21.15.73:0/1245724020 >> 172.21.15.73:0/1245724020 conn(0x7f29600abe30 msgr2=0x7f29600a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.751+0000 7f2967110640 1 -- 172.21.15.73:0/1245724020 shutdown_connections 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.751+0000 7f2967110640 1 -- 172.21.15.73:0/1245724020 wait complete. 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.752+0000 7f2967110640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.752+0000 7f2967110640 10 monclient: monmap: 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.768 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.752+0000 7f2967110640 1 Processor -- start 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.752+0000 7f2967110640 1 -- start start 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.752+0000 7f2967110640 10 monclient: init 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 10 monclient: _add_conns ranks=[4,0,5,3,6,1,8,2,7] 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 10 monclient(hunting): picked mon.noname-c con 0x7f29600a5b30 addr v1:172.21.15.73:6791/0 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 10 monclient(hunting): picked mon.noname-a con 0x7f29600a6620 addr v1:172.21.15.73:6789/0 2024-09-11T01:59:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 10 monclient(hunting): picked mon.noname-h con 0x7f29601cd050 addr v1:172.21.15.203:6791/0 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29601287d0 con 0x7f29600a6620 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2960128ab0 con 0x7f29600a5b30 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2960127590 con 0x7f29601cd050 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 10 monclient(hunting): authenticate will time out at 784.357153s 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2964eac640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f29600a5b30 0x7f2960141330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43928/0 (socket says 172.21.15.73:43928) 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f29600a6620 0x7f29601d23d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47438/0 (socket says 172.21.15.73:47438) 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2964eac640 1 -- 172.21.15.73:0/3257256846 learned_addr learned my addr 172.21.15.73:0/3257256846 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529936483 0 0) 0x7f29601287d0 con 0x7f29600a6620 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): my global_id is 4644 2024-09-11T01:59:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f294c003520 con 0x7f29600a6620 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897326019 0 0) 0x7f2960128ab0 con 0x7f29600a5b30 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): my global_id is 4522 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29601287d0 con 0x7f29600a5b30 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605090665 0 0) 0x7f2960127590 con 0x7f29601cd050 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): my global_id is 4559 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2960128ab0 con 0x7f29601cd050 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3852643652 0 0) 0x7f29601287d0 con 0x7f29600a5b30 2024-09-11T01:59:02.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2960127590 con 0x7f29600a5b30 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2139692754 0 0) 0x7f294c003520 con 0x7f29600a6620 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29601287d0 con 0x7f29600a6620 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f29500043b0 con 0x7f29600a5b30 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): dump: 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2954001c00 con 0x7f29600a6620 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): dump: 2024-09-11T01:59:02.773 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.774 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 754565847 0 0) 0x7f2960128ab0 con 0x7f29601cd050 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f294c003520 con 0x7f29601cd050 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2958001d00 con 0x7f29601cd050 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient(hunting): dump: 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.775 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 482630988 0 0) 0x7f2960127590 con 0x7f29600a5b30 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 >> v1:172.21.15.203:6791/0 conn(0x7f29601cd050 legacy=0x7f29601d5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 >> v1:172.21.15.73:6789/0 conn(0x7f29600a6620 legacy=0x7f29601d23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 monclient: found mon.c 2024-09-11T01:59:02.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2960141a40 con 0x7f29600a5b30 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f295d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.753+0000 7f2967110640 5 monclient: authenticate success, global_id 4522 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f2967110640 10 monclient: _renew_subs 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f2967110640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f29601d7220 con 0x7f29600a5b30 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f2967110640 10 monclient: _renew_subs 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f2967110640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f29601d75d0 con 0x7f29600a5b30 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2950004870 con 0x7f29600a5b30 2024-09-11T01:59:02.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f295d7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2950004da0 con 0x7f29600a5b30 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f295d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f295effd640 4 set_mon_vals no callback set 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f295d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f295d7fa640 10 monclient: dump: 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.778 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f2967110640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.754+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f29400065c0 con 0x7f2940002860 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f2950004f40 con 0x7f29600a5b30 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 206582418 0 0) 0x7f295004e430 con 0x7f29600a5b30 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237558507 0 0) 0x7f29400065c0 con 0x7f2940002860 2024-09-11T01:59:02.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 10 monclient(hunting): my global_id is 4492 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2960127590 con 0x7f2940002860 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f29656ad640 10 monclient: get_auth_request con 0x7f294c040680 auth_method 0 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4023134652 0 0) 0x7f2960127590 con 0x7f2940002860 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29400065c0 con 0x7f2940002860 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2954001910 con 0x7f2940002860 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 10 monclient: dump: 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.780 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.781 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3848902729 0 0) 0x7f29400065c0 con 0x7f2940002860 2024-09-11T01:59:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.755+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f294000a160 con 0x7f2940002860 2024-09-11T01:59:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.756+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f29540051a0 con 0x7f2940002860 2024-09-11T01:59:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.756+0000 7f295d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.756+0000 7f295d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:59:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.756+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 >> v1:172.21.15.203:6789/0 conn(0x7f2940002860 legacy=0x7f2940004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.756+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 >> v1:172.21.15.203:6789/0 conn(0x7f2940002860 legacy=0x7f2940004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f2967110640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2940009e70 con 0x7f2940009130 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379049857 0 0) 0x7f2940009e70 con 0x7f2940009130 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 10 monclient(hunting): my global_id is 4501 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29400065c0 con 0x7f2940009130 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1480787839 0 0) 0x7f29400065c0 con 0x7f2940009130 2024-09-11T01:59:02.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2940009e70 con 0x7f2940009130 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2954005980 con 0x7f2940009130 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.762+0000 7f295d7fa640 10 monclient: dump: 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.785 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1781243753 0 0) 0x7f2940009e70 con 0x7f2940009130 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 --> v1:172.21.15.203:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f294000c410 con 0x7f2940009130 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7521 (unknown 0 0 1793711415) 0x7f2954007ee0 con 0x7f2940009130 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f295d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f295d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 >> v1:172.21.15.203:6789/0 conn(0x7f2940009130 legacy=0x7f29400095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f295d7fa640 1 -- 172.21.15.73:0/3257256846 >> v1:172.21.15.203:6789/0 conn(0x7f2940009130 legacy=0x7f29400095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 18, 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 65179, 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:59:02.787 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: 7 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.788 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.789 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:59:02.790 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.791 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:59:02.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.793 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.795 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:59:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:59:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.797 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:59:02.798 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.799 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.801 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:59:02.802 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:02.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:59:02.806 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 >> v1:172.21.15.203:6812/2311533528 conn(0x7f294c040680 legacy=0x7f294c042b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f2967110640 10 monclient: shutdown 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f2967110640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 >> v1:172.21.15.73:6791/0 conn(0x7f29600a5b30 legacy=0x7f2960141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f29656ad640 1 -- 172.21.15.73:0/3257256846 reap_dead start 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f29656ad640 1 -- 172.21.15.73:0/3257256846 reap_dead start 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 shutdown_connections 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 >> 172.21.15.73:0/3257256846 conn(0x7f296009db70 msgr2=0x7f29600a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 shutdown_connections 2024-09-11T01:59:02.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.763+0000 7f2967110640 1 -- 172.21.15.73:0/3257256846 wait complete. 2024-09-11T01:59:02.809 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T01:59:02.809 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-09-11T01:59:02.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-11T01:59:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.905+0000 7f995d2b8640 10 monclient: get_monmap_and_config 2024-09-11T01:59:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.905+0000 7f995d2b8640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.905+0000 7f995d2b8640 10 monclient: monmap: 2024-09-11T01:59:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:59:02.906741+0000 2024-09-11T01:59:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:59:02.906741+0000 2024-09-11T01:59:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.909 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.906+0000 7f995d2b8640 1 Processor -- start 2024-09-11T01:59:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.906+0000 7f995d2b8640 1 -- start start 2024-09-11T01:59:02.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.906+0000 7f995d2b8640 10 monclient: init 2024-09-11T01:59:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.906+0000 7f995d2b8640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.906+0000 7f995d2b8640 10 monclient: _add_conns ranks=[0,7,2,1,8,5,6,4,3] 2024-09-11T01:59:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.906+0000 7f995d2b8640 10 monclient(hunting): picked mon.noname-a con 0x7f9958138d40 addr v1:172.21.15.73:6789/0 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.906+0000 7f995d2b8640 10 monclient(hunting): picked mon.noname-i con 0x7f99580a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 10 monclient(hunting): picked mon.noname-b con 0x7f995813f350 addr v1:172.21.15.73:6790/0 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995809ca00 con 0x7f9958138d40 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99580a7070 con 0x7f995813f350 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995809cee0 con 0x7f99580a72f0 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 10 monclient(hunting): authenticate will time out at 784.511078s 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9956ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9958138d40 0x7f9958139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47440/0 (socket says 172.21.15.73:47440) 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9956ffd640 1 -- 172.21.15.73:0/2307489808 learned_addr learned my addr 172.21.15.73:0/2307489808 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260362326 0 0) 0x7f995809ca00 con 0x7f9958138d40 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient(hunting): my global_id is 4653 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9940003520 con 0x7f9958138d40 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555841986 0 0) 0x7f99580a7070 con 0x7f995813f350 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient(hunting): my global_id is 4556 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f995809ca00 con 0x7f995813f350 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1390506311 0 0) 0x7f9940003520 con 0x7f9958138d40 2024-09-11T01:59:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 >> v1:172.21.15.203:6792/0 conn(0x7f99580a72f0 legacy=0x7f995813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 >> v1:172.21.15.73:6790/0 conn(0x7f995813f350 legacy=0x7f9958141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 monclient: found mon.noname-a 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995809d1c0 con 0x7f9958138d40 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9950001850 con 0x7f9958138d40 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 5 monclient: authenticate success, global_id 4653 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:02.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: dump: 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.923 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9950001a70 con 0x7f9958138d40 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 1 -- 172.21.15.73:0/2307489808 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9950001c60 con 0x7f9958138d40 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 10 monclient: get_monmap_and_config success 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f995d2b8640 4 set_mon_vals no callback set 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T01:59:02.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.907+0000 7f9955ffb640 10 monclient: dump: 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.925 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.908+0000 7f995d2b8640 10 monclient: shutdown 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.908+0000 7f995d2b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.908+0000 7f995d2b8640 1 -- 172.21.15.73:0/2307489808 >> v1:172.21.15.73:6789/0 conn(0x7f9958138d40 legacy=0x7f9958139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.908+0000 7f995d2b8640 1 -- 172.21.15.73:0/2307489808 shutdown_connections 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.908+0000 7f995d2b8640 1 -- 172.21.15.73:0/2307489808 >> 172.21.15.73:0/2307489808 conn(0x7f99580a8050 msgr2=0x7f99580a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.908+0000 7f995d2b8640 1 -- 172.21.15.73:0/2307489808 shutdown_connections 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.908+0000 7f995d2b8640 1 -- 172.21.15.73:0/2307489808 wait complete. 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.908+0000 7f995d2b8640 10 monclient: build_initial_monmap 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.908+0000 7f995d2b8640 10 monclient: monmap: 2024-09-11T01:59:02.926 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:02.927 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 1 Processor -- start 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 1 -- start start 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 10 monclient: init 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 10 monclient: _add_conns ranks=[2,1,4,6,7,8,5,0,3] 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 10 monclient(hunting): picked mon.noname-b con 0x7f99580a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 10 monclient(hunting): picked mon.noname-f con 0x7f9958138d40 addr v1:172.21.15.203:6789/0 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 10 monclient(hunting): picked mon.noname-c con 0x7f995813f350 addr v1:172.21.15.73:6791/0 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995813a800 con 0x7f9958138d40 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9958142860 con 0x7f99580a72f0 2024-09-11T01:59:02.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99580a5310 con 0x7f995813f350 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f995d2b8640 10 monclient(hunting): authenticate will time out at 784.513880s 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f9956ffd640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f99580a72f0 0x7f99581399e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:39750/0 (socket says 172.21.15.73:39750) 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.909+0000 7f9956ffd640 1 -- 172.21.15.73:0/3224480047 learned_addr learned my addr 172.21.15.73:0/3224480047 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380518439 0 0) 0x7f9958142860 con 0x7f99580a72f0 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): my global_id is 4565 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9944003520 con 0x7f99580a72f0 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508326154 0 0) 0x7f99580a5310 con 0x7f995813f350 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): my global_id is 4531 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9958142860 con 0x7f995813f350 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 976236907 0 0) 0x7f9944003520 con 0x7f99580a72f0 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99580a5310 con 0x7f99580a72f0 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9950001810 con 0x7f99580a72f0 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): dump: 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.930 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1669829555 0 0) 0x7f9958142860 con 0x7f995813f350 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9944003520 con 0x7f995813f350 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9948001860 con 0x7f995813f350 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): dump: 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.932 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962983248 0 0) 0x7f995813a800 con 0x7f9958138d40 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient(hunting): my global_id is 4510 2024-09-11T01:59:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9958142860 con 0x7f9958138d40 2024-09-11T01:59:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 432664756 0 0) 0x7f99580a5310 con 0x7f99580a72f0 2024-09-11T01:59:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 >> v1:172.21.15.73:6791/0 conn(0x7f995813f350 legacy=0x7f99581d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 >> v1:172.21.15.203:6789/0 conn(0x7f9958138d40 legacy=0x7f995813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient: _finish_hunting 0 2024-09-11T01:59:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 monclient: found mon.b 2024-09-11T01:59:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958142340 con 0x7f99580a72f0 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient: _finish_auth 0 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient: _check_auth_tickets 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f995d2b8640 5 monclient: authenticate success, global_id 4565 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f995d2b8640 10 monclient: _renew_subs 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f995d2b8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f995813c890 con 0x7f99580a72f0 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f995d2b8640 10 monclient: _renew_subs 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f995d2b8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f995813e550 con 0x7f99580a72f0 2024-09-11T01:59:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9950001ce0 con 0x7f99580a72f0 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9950005270 con 0x7f99580a72f0 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f99557fa640 4 set_mon_vals no callback set 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.910+0000 7f993f7fe640 10 monclient: dump: 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f995d2b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f99500119b0 con 0x7f99580a72f0 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f99380065c0 con 0x7f9938002860 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 206582418 0 0) 0x7f995004e480 con 0x7f99580a72f0 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f99577fe640 10 monclient: get_auth_request con 0x7f99440403b0 auth_method 0 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 501310144 0 0) 0x7f99380065c0 con 0x7f9938002860 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f993f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f993f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f993f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f993f7fe640 10 monclient(hunting): my global_id is 4575 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.911+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99580a5310 con 0x7f9938002860 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2770593027 0 0) 0x7f99580a5310 con 0x7f9938002860 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99380065c0 con 0x7f9938002860 2024-09-11T01:59:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f994c001d30 con 0x7f9938002860 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 10 monclient: dump: 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 761701552 0 0) 0x7f99380065c0 con 0x7f9938002860 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.203:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f993800a160 con 0x7f9938002860 2024-09-11T01:59:02.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f994c002020 con 0x7f9938002860 2024-09-11T01:59:02.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:02.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:59:02.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 >> v1:172.21.15.203:6790/0 conn(0x7f9938002860 legacy=0x7f9938004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.912+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 >> v1:172.21.15.203:6790/0 conn(0x7f9938002860 legacy=0x7f9938004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.918+0000 7f995d2b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.918+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9938009e70 con 0x7f9938009130 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554296248 0 0) 0x7f9938009e70 con 0x7f9938009130 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 10 monclient(hunting): _negotiate 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 10 monclient(hunting): my global_id is 4584 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99380065c0 con 0x7f9938009130 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1305073624 0 0) 0x7f99380065c0 con 0x7f9938009130 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9938009e70 con 0x7f9938009130 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f994c003f30 con 0x7f9938009130 2024-09-11T01:59:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 10 monclient: dump: 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1554077998 0 0) 0x7f9938009e70 con 0x7f9938009130 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.919+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 --> v1:172.21.15.203:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f993800c3f0 con 0x7f9938009130 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7688 (unknown 0 0 2474010323) 0x7f994c005380 con 0x7f9938009130 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f993f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f993f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 >> v1:172.21.15.203:6790/0 conn(0x7f9938009130 legacy=0x7f99380095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f993f7fe640 1 -- 172.21.15.73:0/3224480047 >> v1:172.21.15.203:6790/0 conn(0x7f9938009130 legacy=0x7f99380095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 18, 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 65357, 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:59:02.946 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: 7 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.947 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:59:02.948 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.949 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:59:02.950 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:02.951 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:02.952 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.952 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:59:02.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.952 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:59:02.952 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.952 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.953 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.954 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.955 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:59:02.955 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.955 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.955 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.955 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.955 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.955 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:59:02.955 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.955 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.956 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.957 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.958 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.960 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.961 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.962 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.963 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.964 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:02.965 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.966 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:02.967 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-09-11T01:59:02.968 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:02.968 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:02.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:02.968 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:59:02.968 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:59:02.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 >> v1:172.21.15.203:6812/2311533528 conn(0x7f99440403b0 legacy=0x7f9944042870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f995d2b8640 10 monclient: shutdown 2024-09-11T01:59:02.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f995d2b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:02.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 >> v1:172.21.15.73:6790/0 conn(0x7f99580a72f0 legacy=0x7f99581399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:02.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f99577fe640 1 -- 172.21.15.73:0/3224480047 reap_dead start 2024-09-11T01:59:02.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f99577fe640 1 -- 172.21.15.73:0/3224480047 reap_dead start 2024-09-11T01:59:02.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 shutdown_connections 2024-09-11T01:59:02.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 >> 172.21.15.73:0/3224480047 conn(0x7f99580a8050 msgr2=0x7f995813ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:02.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 shutdown_connections 2024-09-11T01:59:02.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:02.920+0000 7f995d2b8640 1 -- 172.21.15.73:0/3224480047 wait complete. 2024-09-11T01:59:02.970 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T01:59:02.970 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon h 2024-09-11T01:59:02.971 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-11T01:59:02.971 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[34905]: starting. 2024-09-11T01:59:02.971 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[34905]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-34903 2024-09-11T01:59:02.971 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[34905]: shutting down. 2024-09-11T01:59:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.068+0000 7ff4408e2640 10 monclient: get_monmap_and_config 2024-09-11T01:59:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.068+0000 7ff4408e2640 10 monclient: build_initial_monmap 2024-09-11T01:59:03.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.068+0000 7ff4408e2640 10 monclient: monmap: 2024-09-11T01:59:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:59:03.068970+0000 2024-09-11T01:59:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:59:03.068970+0000 2024-09-11T01:59:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:03.071 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.068+0000 7ff4408e2640 1 Processor -- start 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.068+0000 7ff4408e2640 1 -- start start 2024-09-11T01:59:03.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.068+0000 7ff4408e2640 10 monclient: init 2024-09-11T01:59:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 10 monclient: _add_conns ranks=[4,8,2,0,5,3,6,7,1] 2024-09-11T01:59:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 10 monclient(hunting): picked mon.noname-c con 0x7ff43c138960 addr v1:172.21.15.73:6791/0 2024-09-11T01:59:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 10 monclient(hunting): picked mon.noname-e con 0x7ff43c139450 addr v1:172.21.15.73:6793/0 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 10 monclient(hunting): picked mon.noname-b con 0x7ff43c13f620 addr v1:172.21.15.73:6790/0 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c09d030 con 0x7ff43c13f620 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c09d310 con 0x7ff43c138960 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c06f770 con 0x7ff43c139450 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff4408e2640 10 monclient(hunting): authenticate will time out at 784.673373s 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff439d9b640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7ff43c139450 legacy=0x7ff43c13df00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43ad9d640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7ff43c13f620 0x7ff43c141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:39766/0 (socket says 172.21.15.73:39766) 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43a59c640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7ff43c138960 0x7ff43c138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43944/0 (socket says 172.21.15.73:43944) 2024-09-11T01:59:03.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43ad9d640 1 -- 172.21.15.73:0/2434231548 learned_addr learned my addr 172.21.15.73:0/2434231548 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124333677 0 0) 0x7ff43c09d030 con 0x7ff43c13f620 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient(hunting): my global_id is 4601 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff424003520 con 0x7ff43c13f620 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791271563 0 0) 0x7ff43c09d310 con 0x7ff43c138960 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient(hunting): my global_id is 4558 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff43c09d030 con 0x7ff43c138960 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2757804616 0 0) 0x7ff424003520 con 0x7ff43c13f620 2024-09-11T01:59:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 >> v1:172.21.15.73:6793/0 conn(0x7ff43c139450 legacy=0x7ff43c13df00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 >> v1:172.21.15.73:6791/0 conn(0x7ff43c138960 legacy=0x7ff43c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient: _finish_hunting 0 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 monclient: found mon.noname-b 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c0a7360 con 0x7ff43c13f620 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient: _finish_auth 0 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 10 monclient: _check_auth_tickets 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.069+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff434001bb0 con 0x7ff43c13f620 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 5 monclient: authenticate success, global_id 4601 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:03.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff43959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff43959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff43959a640 10 monclient: dump: 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.085 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff434001dd0 con 0x7ff43c13f620 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff43959a640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff43959a640 1 -- 172.21.15.73:0/2434231548 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff4340020c0 con 0x7ff43c13f620 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 10 monclient: get_monmap_and_config success 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 4 set_mon_vals no callback set 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff43959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff43959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff43959a640 10 monclient: dump: 2024-09-11T01:59:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 10 monclient: shutdown 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 1 -- 172.21.15.73:0/2434231548 >> v1:172.21.15.73:6790/0 conn(0x7ff43c13f620 legacy=0x7ff43c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 1 -- 172.21.15.73:0/2434231548 shutdown_connections 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 1 -- 172.21.15.73:0/2434231548 >> 172.21.15.73:0/2434231548 conn(0x7ff43c0a8050 msgr2=0x7ff43c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 1 -- 172.21.15.73:0/2434231548 shutdown_connections 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.070+0000 7ff4408e2640 1 -- 172.21.15.73:0/2434231548 wait complete. 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.071+0000 7ff4408e2640 10 monclient: build_initial_monmap 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.071+0000 7ff4408e2640 10 monclient: monmap: 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:59:03.088 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:59:03.089 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:59:03.089 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:03.089 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:59:03.089 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:03.089 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:03.089 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:03.090 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:03.090 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:03.090 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:03.090 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:03.090 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:03.090 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:03.091 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.071+0000 7ff4408e2640 1 Processor -- start 2024-09-11T01:59:03.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.071+0000 7ff4408e2640 1 -- start start 2024-09-11T01:59:03.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.071+0000 7ff4408e2640 10 monclient: init 2024-09-11T01:59:03.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:03.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient: _add_conns ranks=[2,8,6,7,4,0,1,3,5] 2024-09-11T01:59:03.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient(hunting): picked mon.noname-b con 0x7ff43c138960 addr v1:172.21.15.73:6790/0 2024-09-11T01:59:03.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient(hunting): picked mon.noname-e con 0x7ff43c139450 addr v1:172.21.15.73:6793/0 2024-09-11T01:59:03.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient(hunting): picked mon.noname-d con 0x7ff43c13f620 addr v1:172.21.15.73:6792/0 2024-09-11T01:59:03.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c13d3b0 con 0x7ff43c138960 2024-09-11T01:59:03.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c13aaf0 con 0x7ff43c13f620 2024-09-11T01:59:03.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c06e680 con 0x7ff43c139450 2024-09-11T01:59:03.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:03.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff439d9b640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7ff43c139450 legacy=0x7ff43c13a3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:03.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient(hunting): authenticate will time out at 784.676243s 2024-09-11T01:59:03.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff43ad9d640 1 -- >> v1:172.21.15.73:6792/0 conn(0x7ff43c13f620 legacy=0x7ff43c1d57f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6792/0 2024-09-11T01:59:03.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff43a59c640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7ff43c138960 0x7ff43c139cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:39782/0 (socket says 172.21.15.73:39782) 2024-09-11T01:59:03.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff43a59c640 1 -- 172.21.15.73:0/3987959873 learned_addr learned my addr 172.21.15.73:0/3987959873 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:03.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229672050 0 0) 0x7ff42c001940 con 0x7ff43c138960 2024-09-11T01:59:03.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient(hunting): my global_id is 4610 2024-09-11T01:59:03.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff41c003520 con 0x7ff43c138960 2024-09-11T01:59:03.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1014039201 0 0) 0x7ff41c003520 con 0x7ff43c138960 2024-09-11T01:59:03.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff42c001940 con 0x7ff43c138960 2024-09-11T01:59:03.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff42c001c70 con 0x7ff43c138960 2024-09-11T01:59:03.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:03.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:59:03.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient(hunting): dump: 2024-09-11T01:59:03.096 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.096 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.096 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.097 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.097 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.097 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.097 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.097 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.097 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.098 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.098 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.098 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.098 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.098 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.098 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.099 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:59:03.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1757829780 0 0) 0x7ff42c001940 con 0x7ff43c138960 2024-09-11T01:59:03.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 >> v1:172.21.15.73:6793/0 conn(0x7ff43c139450 legacy=0x7ff43c13a3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:59:03.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 >> v1:172.21.15.73:6792/0 conn(0x7ff43c13f620 legacy=0x7ff43c1d57f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:59:03.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient: _finish_hunting 0 2024-09-11T01:59:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 monclient: found mon.b 2024-09-11T01:59:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:59:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c142a50 con 0x7ff43c138960 2024-09-11T01:59:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient: _finish_auth 0 2024-09-11T01:59:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient: _check_auth_tickets 2024-09-11T01:59:03.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:03.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 5 monclient: authenticate success, global_id 4610 2024-09-11T01:59:03.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient: _renew_subs 2024-09-11T01:59:03.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:59:03.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c13f0e0 con 0x7ff43c138960 2024-09-11T01:59:03.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient: _renew_subs 2024-09-11T01:59:03.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T01:59:03.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff43c0a4830 con 0x7ff43c138960 2024-09-11T01:59:03.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff42c004a90 con 0x7ff43c138960 2024-09-11T01:59:03.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:03.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff42c0050c0 con 0x7ff43c138960 2024-09-11T01:59:03.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:59:03.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff438d99640 4 set_mon_vals no callback set 2024-09-11T01:59:03.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.072+0000 7ff42affd640 10 monclient: dump: 2024-09-11T01:59:03.103 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.106 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.073+0000 7ff4408e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.073+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff4200065c0 con 0x7ff420002860 2024-09-11T01:59:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.073+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7ff42c0052e0 con 0x7ff43c138960 2024-09-11T01:59:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 1598335466 0 0) 0x7ff42c04e540 con 0x7ff43c138960 2024-09-11T01:59:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff43ad9d640 10 monclient: get_auth_request con 0x7ff41c03fb40 auth_method 0 2024-09-11T01:59:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060641822 0 0) 0x7ff4200065c0 con 0x7ff420002860 2024-09-11T01:59:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 10 monclient(hunting): my global_id is 4595 2024-09-11T01:59:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff42c001940 con 0x7ff420002860 2024-09-11T01:59:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1327185973 0 0) 0x7ff42c001940 con 0x7ff420002860 2024-09-11T01:59:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4200065c0 con 0x7ff420002860 2024-09-11T01:59:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff430004140 con 0x7ff420002860 2024-09-11T01:59:03.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:59:03.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 10 monclient: dump: 2024-09-11T01:59:03.109 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.109 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.111 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1892303688 0 0) 0x7ff4200065c0 con 0x7ff420002860 2024-09-11T01:59:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.074+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.203:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff42000a160 con 0x7ff420002860 2024-09-11T01:59:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.075+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff430006400 con 0x7ff420002860 2024-09-11T01:59:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.075+0000 7ff42affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.075+0000 7ff42affd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:59:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.075+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 >> v1:172.21.15.203:6791/0 conn(0x7ff420002860 legacy=0x7ff420004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.075+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 >> v1:172.21.15.203:6791/0 conn(0x7ff420002860 legacy=0x7ff420004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff4408e2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:59:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff420009e70 con 0x7ff420009130 2024-09-11T01:59:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381993365 0 0) 0x7ff420009e70 con 0x7ff420009130 2024-09-11T01:59:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 10 monclient(hunting): my global_id is 4604 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4200065c0 con 0x7ff420009130 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3982965893 0 0) 0x7ff4200065c0 con 0x7ff420009130 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff420009e70 con 0x7ff420009130 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff430005d30 con 0x7ff420009130 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.081+0000 7ff42affd640 10 monclient: dump: 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.118 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2110449418 0 0) 0x7ff420009e70 con 0x7ff420009130 2024-09-11T01:59:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 --> v1:172.21.15.203:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff42000c410 con 0x7ff420009130 2024-09-11T01:59:03.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7521 (unknown 0 0 442701819) 0x7ff430005da0 con 0x7ff420009130 2024-09-11T01:59:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff42affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:59:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff42affd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:59:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 >> v1:172.21.15.203:6791/0 conn(0x7ff420009130 legacy=0x7ff4200095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff42affd640 1 -- 172.21.15.73:0/3987959873 >> v1:172.21.15.203:6791/0 conn(0x7ff420009130 legacy=0x7ff4200095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:03.120 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:59:03.120 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:59:03.120 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:59:03.120 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:59:03.120 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 18, 2024-09-11T01:59:03.120 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 65519, 2024-09-11T01:59:03.121 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:59:03.121 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:59:03.121 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:59:03.121 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:59:03.121 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:59:03.121 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: 7 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:03.122 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:03.123 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:59:03.124 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:59:03.125 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:59:03.125 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:59:03.125 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:59:03.125 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:59:03.125 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:03.125 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:03.125 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:59:03.125 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:59:03.125 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:03.126 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:03.127 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:03.127 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:03.127 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:03.127 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:03.127 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:59:03.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.127 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:59:03.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.127 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.129 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.131 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.132 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:59:03.133 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:59:03.135 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.136 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.137 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.138 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:59:03.138 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:59:03.138 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.138 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.138 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:59:03.139 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:59:03.140 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:59:03.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.142 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:59:03.143 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:59:03.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 >> v1:172.21.15.203:6812/2311533528 conn(0x7ff41c03fb40 legacy=0x7ff41c042000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff4408e2640 10 monclient: shutdown 2024-09-11T01:59:03.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff4408e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:03.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 >> v1:172.21.15.73:6790/0 conn(0x7ff43c138960 legacy=0x7ff43c139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff43ad9d640 1 -- 172.21.15.73:0/3987959873 reap_dead start 2024-09-11T01:59:03.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff43ad9d640 1 -- 172.21.15.73:0/3987959873 reap_dead start 2024-09-11T01:59:03.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 shutdown_connections 2024-09-11T01:59:03.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 >> 172.21.15.73:0/3987959873 conn(0x7ff43c0a8050 msgr2=0x7ff43c0a8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:03.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 shutdown_connections 2024-09-11T01:59:03.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.082+0000 7ff4408e2640 1 -- 172.21.15.73:0/3987959873 wait complete. 2024-09-11T01:59:03.145 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T01:59:03.145 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon i 2024-09-11T01:59:03.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-11T01:59:03.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.244+0000 7fd0e05b4640 10 monclient: get_monmap_and_config 2024-09-11T01:59:03.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.244+0000 7fd0e05b4640 10 monclient: build_initial_monmap 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.244+0000 7fd0e05b4640 10 monclient: monmap: 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:59:03.245568+0000 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:59:03.245568+0000 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:03.247 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:03.248 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:03.248 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 1 Processor -- start 2024-09-11T01:59:03.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 1 -- start start 2024-09-11T01:59:03.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 10 monclient: init 2024-09-11T01:59:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 10 monclient: _add_conns ranks=[2,7,8,6,5,0,4,1,3] 2024-09-11T01:59:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 10 monclient(hunting): picked mon.noname-b con 0x7fd0d8138d40 addr v1:172.21.15.73:6790/0 2024-09-11T01:59:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 10 monclient(hunting): picked mon.noname-i con 0x7fd0d80a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T01:59:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 10 monclient(hunting): picked mon.noname-e con 0x7fd0d813f350 addr v1:172.21.15.73:6793/0 2024-09-11T01:59:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d809ca00 con 0x7fd0d8138d40 2024-09-11T01:59:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d80a7070 con 0x7fd0d80a72f0 2024-09-11T01:59:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d809cee0 con 0x7fd0d813f350 2024-09-11T01:59:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0e05b4640 10 monclient(hunting): authenticate will time out at 784.849974s 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.245+0000 7fd0deb51640 1 -- >> v1:172.21.15.73:6793/0 conn(0x7fd0d813f350 legacy=0x7fd0d8141740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6793/0 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0de350640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fd0d8138d40 0x7fd0d8139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:39792/0 (socket says 172.21.15.73:39792) 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0de350640 1 -- 172.21.15.73:0/3609546331 learned_addr learned my addr 172.21.15.73:0/3609546331 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 -- 172.21.15.73:0/3609546331 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3445373876 0 0) 0x7fd0d809ca00 con 0x7fd0d8138d40 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient(hunting): my global_id is 4619 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 -- 172.21.15.73:0/3609546331 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0c4003520 con 0x7fd0d8138d40 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 -- 172.21.15.73:0/3609546331 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3063620136 0 0) 0x7fd0c4003520 con 0x7fd0d8138d40 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 -- 172.21.15.73:0/3609546331 >> v1:172.21.15.73:6793/0 conn(0x7fd0d813f350 legacy=0x7fd0d8141740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 -- 172.21.15.73:0/3609546331 >> v1:172.21.15.203:6792/0 conn(0x7fd0d80a72f0 legacy=0x7fd0d813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: _finish_hunting 0 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 monclient: found mon.noname-b 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 -- 172.21.15.73:0/3609546331 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d809d1c0 con 0x7fd0d8138d40 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: _finish_auth 0 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: _check_auth_tickets 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 -- 172.21.15.73:0/3609546331 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd0d4001850 con 0x7fd0d8138d40 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0e05b4640 5 monclient: authenticate success, global_id 4619 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0e05b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T01:59:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: dump: 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0e05b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 -- 172.21.15.73:0/3609546331 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0d4001a70 con 0x7fd0d8138d40 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 1 -- 172.21.15.73:0/3609546331 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd0d4004be0 con 0x7fd0d8138d40 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0e05b4640 10 monclient: get_monmap_and_config success 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0e05b4640 4 set_mon_vals no callback set 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.246+0000 7fd0dd34e640 10 monclient: dump: 2024-09-11T01:59:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.247+0000 7fd0e05b4640 10 monclient: shutdown 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.247+0000 7fd0e05b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.247+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3609546331 >> v1:172.21.15.73:6790/0 conn(0x7fd0d8138d40 legacy=0x7fd0d8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.247+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3609546331 shutdown_connections 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.247+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3609546331 >> 172.21.15.73:0/3609546331 conn(0x7fd0d80a8050 msgr2=0x7fd0d80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.247+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3609546331 shutdown_connections 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.247+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3609546331 wait complete. 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.247+0000 7fd0e05b4640 10 monclient: build_initial_monmap 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.247+0000 7fd0e05b4640 10 monclient: monmap: 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T01:59:03.264 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T01:59:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 1 Processor -- start 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 1 -- start start 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 10 monclient: init 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 10 monclient: _reopen_session rank -1 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 10 monclient: _add_conns ranks=[4,1,0,5,7,6,8,2,3] 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 10 monclient(hunting): picked mon.noname-c con 0x7fd0d80a72f0 addr v1:172.21.15.73:6791/0 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 10 monclient(hunting): picked mon.noname-f con 0x7fd0d8138d40 addr v1:172.21.15.203:6789/0 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 10 monclient(hunting): picked mon.noname-a con 0x7fd0d813f350 addr v1:172.21.15.73:6789/0 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d8142a80 con 0x7fd0d813f350 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d80a9360 con 0x7fd0d8138d40 2024-09-11T01:59:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d813b840 con 0x7fd0d80a72f0 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 10 monclient(hunting): _renew_subs 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0e05b4640 10 monclient(hunting): authenticate will time out at 784.852643s 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0de350640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fd0d80a72f0 0x7fd0d81399e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43952/0 (socket says 172.21.15.73:43952) 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0de350640 1 -- 172.21.15.73:0/3988095821 learned_addr learned my addr 172.21.15.73:0/3988095821 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081427566 0 0) 0x7fd0d813b840 con 0x7fd0d80a72f0 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 10 monclient(hunting): my global_id is 4567 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0bc003520 con 0x7fd0d80a72f0 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1853397048 0 0) 0x7fd0d8142a80 con 0x7fd0d813f350 2024-09-11T01:59:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 10 monclient(hunting): my global_id is 4680 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.248+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d813b840 con 0x7fd0d813f350 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89196353 0 0) 0x7fd0d80a9360 con 0x7fd0d8138d40 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): my global_id is 4519 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d8142a80 con 0x7fd0d8138d40 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1424617862 0 0) 0x7fd0bc003520 con 0x7fd0d80a72f0 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0d80a9360 con 0x7fd0d80a72f0 2024-09-11T01:59:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd0d4004b20 con 0x7fd0d80a72f0 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): dump: 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2524745513 0 0) 0x7fd0d813b840 con 0x7fd0d813f350 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0bc003520 con 0x7fd0d813f350 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd0d0004550 con 0x7fd0d813f350 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): dump: 2024-09-11T01:59:03.270 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.271 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2790725622 0 0) 0x7fd0d8142a80 con 0x7fd0d8138d40 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0d813b840 con 0x7fd0d8138d40 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd0c8001a50 con 0x7fd0d8138d40 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient(hunting): dump: 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.273 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.274 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.274 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.274 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.274 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4259364369 0 0) 0x7fd0d80a9360 con 0x7fd0d80a72f0 2024-09-11T01:59:03.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 >> v1:172.21.15.203:6789/0 conn(0x7fd0d8138d40 legacy=0x7fd0d813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 >> v1:172.21.15.73:6789/0 conn(0x7fd0d813f350 legacy=0x7fd0d81d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient: _finish_hunting 0 2024-09-11T01:59:03.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 monclient: found mon.c 2024-09-11T01:59:03.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T01:59:03.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:59:03.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d80a18d0 con 0x7fd0d80a72f0 2024-09-11T01:59:03.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient: _finish_auth 0 2024-09-11T01:59:03.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient: _check_auth_tickets 2024-09-11T01:59:03.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T01:59:03.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0e05b4640 5 monclient: authenticate success, global_id 4567 2024-09-11T01:59:03.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0e05b4640 10 monclient: _renew_subs 2024-09-11T01:59:03.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0e05b4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:59:03.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d813c660 con 0x7fd0d80a72f0 2024-09-11T01:59:03.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0e05b4640 10 monclient: _renew_subs 2024-09-11T01:59:03.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0e05b4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T01:59:03.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0d80a10c0 con 0x7fd0d80a72f0 2024-09-11T01:59:03.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0d40011b0 con 0x7fd0d80a72f0 2024-09-11T01:59:03.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient: handle_config config(0 keys) 2024-09-11T01:59:03.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd0d4001930 con 0x7fd0d80a72f0 2024-09-11T01:59:03.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0dcb4d640 4 set_mon_vals no callback set 2024-09-11T01:59:03.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T01:59:03.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.249+0000 7fd0ceffd640 10 monclient: dump: 2024-09-11T01:59:03.278 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.278 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.278 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.278 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0e05b4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd0c00065c0 con 0x7fd0c0002860 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fd0d4011780 con 0x7fd0d80a72f0 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 1598335466 0 0) 0x7fd0d404e250 con 0x7fd0d80a72f0 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0deb51640 10 monclient: get_auth_request con 0x7fd0bc040670 auth_method 0 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983770729 0 0) 0x7fd0c00065c0 con 0x7fd0c0002860 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 10 monclient(hunting): my global_id is 4534 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d80a9360 con 0x7fd0c0002860 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3696487005 0 0) 0x7fd0d80a9360 con 0x7fd0c0002860 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0c00065c0 con 0x7fd0c0002860 2024-09-11T01:59:03.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.250+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd0c8003930 con 0x7fd0c0002860 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 10 monclient: dump: 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.281 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 138829608 0 0) 0x7fd0c00065c0 con 0x7fd0c0002860 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0c000a160 con 0x7fd0c0002860 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd0c8005bb0 con 0x7fd0c0002860 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 >> v1:172.21.15.203:6792/0 conn(0x7fd0c0002860 legacy=0x7fd0c0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.251+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 >> v1:172.21.15.203:6792/0 conn(0x7fd0c0002860 legacy=0x7fd0c0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:03.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.257+0000 7fd0e05b4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T01:59:03.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.257+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd0c0009e70 con 0x7fd0c0009130 2024-09-11T01:59:03.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2635122149 0 0) 0x7fd0c0009e70 con 0x7fd0c0009130 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 10 monclient(hunting): _negotiate 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 10 monclient(hunting): my global_id is 4543 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0c00065c0 con 0x7fd0c0009130 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3668303320 0 0) 0x7fd0c00065c0 con 0x7fd0c0009130 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0c0009e70 con 0x7fd0c0009130 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd0c8005530 con 0x7fd0c0009130 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 10 monclient: dump: 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T01:59:03.285 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T01:59:03.286 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 394065537 0 0) 0x7fd0c0009e70 con 0x7fd0c0009130 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.258+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 --> v1:172.21.15.203:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd0c000c410 con 0x7fd0c0009130 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7521 (unknown 0 0 1615349255) 0x7fd0c80057f0 con 0x7fd0c0009130 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0ceffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0ceffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 >> v1:172.21.15.203:6792/0 conn(0x7fd0c0009130 legacy=0x7fd0c00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0ceffd640 1 -- 172.21.15.73:0/3988095821 >> v1:172.21.15.203:6792/0 conn(0x7fd0c0009130 legacy=0x7fd0c00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:59:03.287 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 18, 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 65679, 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: 7 2024-09-11T01:59:03.288 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:03.289 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:03.290 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:03.291 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:03.291 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:03.291 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.291 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T01:59:03.291 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T01:59:03.291 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T01:59:03.291 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T01:59:03.292 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T01:59:03.292 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T01:59:03.292 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:03.292 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T01:59:03.292 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T01:59:03.292 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T01:59:03.293 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T01:59:03.293 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T01:59:03.293 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T01:59:03.293 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T01:59:03.293 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T01:59:03.293 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T01:59:03.294 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T01:59:03.294 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T01:59:03.294 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T01:59:03.294 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T01:59:03.294 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T01:59:03.294 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T01:59:03.294 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T01:59:03.295 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T01:59:03.295 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T01:59:03.295 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T01:59:03.295 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T01:59:03.295 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T01:59:03.295 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:03.295 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T01:59:03.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.296 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T01:59:03.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.296 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T01:59:03.296 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T01:59:03.296 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.296 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.297 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T01:59:03.297 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.297 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.298 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T01:59:03.298 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T01:59:03.298 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.298 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.298 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T01:59:03.299 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T01:59:03.300 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.301 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.302 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T01:59:03.305 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T01:59:03.307 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T01:59:03.307 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.307 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.307 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.307 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T01:59:03.308 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.309 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.309 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.309 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T01:59:03.309 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T01:59:03.309 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T01:59:03.309 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T01:59:03.310 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.310 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T01:59:03.310 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T01:59:03.310 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T01:59:03.310 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.310 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.310 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T01:59:03.310 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T01:59:03.311 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T01:59:03.311 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T01:59:03.311 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T01:59:03.311 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.311 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.311 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.311 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T01:59:03.311 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T01:59:03.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.312 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:03.312 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:03.312 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T01:59:03.312 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.312 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T01:59:03.312 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T01:59:03.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T01:59:03.312 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T01:59:03.313 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T01:59:03.313 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T01:59:03.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T01:59:03.313 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T01:59:03.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T01:59:03.313 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T01:59:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T01:59:03.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 >> v1:172.21.15.203:6812/2311533528 conn(0x7fd0bc040670 legacy=0x7fd0bc042b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0e05b4640 10 monclient: shutdown 2024-09-11T01:59:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0e05b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T01:59:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 >> v1:172.21.15.73:6791/0 conn(0x7fd0d80a72f0 legacy=0x7fd0d81399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:59:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0deb51640 1 -- 172.21.15.73:0/3988095821 reap_dead start 2024-09-11T01:59:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0deb51640 1 -- 172.21.15.73:0/3988095821 reap_dead start 2024-09-11T01:59:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 shutdown_connections 2024-09-11T01:59:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 >> 172.21.15.73:0/3988095821 conn(0x7fd0d80a8050 msgr2=0x7fd0d80a9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:59:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 shutdown_connections 2024-09-11T01:59:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T01:59:03.259+0000 7fd0e05b4640 1 -- 172.21.15.73:0/3988095821 wait complete. 2024-09-11T01:59:03.315 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T01:59:03.316 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-09-11T01:59:05.071 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:05.071 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[34938]: starting. 2024-09-11T01:59:05.071 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[34938]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-34903 2024-09-11T01:59:05.071 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[34938]: created object 0... 2024-09-11T01:59:05.071 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[34938]: created object 25... 2024-09-11T01:59:05.071 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[34938]: created object 49... 2024-09-11T01:59:05.071 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[34938]: finishing. 2024-09-11T01:59:05.071 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[34938]: shutting down. 2024-09-11T01:59:05.082 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:05.082 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[34940]: starting. 2024-09-11T01:59:05.082 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[34940]: listing objects. 2024-09-11T01:59:05.082 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[34940]: listed object 0... 2024-09-11T01:59:05.082 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[34940]: listed object 25... 2024-09-11T01:59:05.082 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[34940]: saw 50 objects 2024-09-11T01:59:05.082 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[34940]: shutting down. 2024-09-11T01:59:05.988 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:05.989 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[34939]: starting. 2024-09-11T01:59:05.989 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[34939]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-34903 2024-09-11T01:59:05.989 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[34939]: shutting down. 2024-09-11T01:59:05.990 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:05.990 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:05.990 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:05.992 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:59:08.093 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35007]: starting. 2024-09-11T01:59:08.094 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35007]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35006 2024-09-11T01:59:08.094 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35007]: created object 0... 2024-09-11T01:59:08.094 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35007]: created object 25... 2024-09-11T01:59:08.094 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35007]: created object 49... 2024-09-11T01:59:08.094 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35007]: finishing. 2024-09-11T01:59:08.094 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35007]: shutting down. 2024-09-11T01:59:09.021 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35008]: starting. 2024-09-11T01:59:09.021 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35008]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35006 2024-09-11T01:59:09.021 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35008]: shutting down. 2024-09-11T01:59:11.136 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:11.136 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35041]: starting. 2024-09-11T01:59:11.136 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35041]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35006 2024-09-11T01:59:11.136 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35041]: created object 0... 2024-09-11T01:59:11.137 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35041]: created object 25... 2024-09-11T01:59:11.137 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35041]: created object 49... 2024-09-11T01:59:11.137 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35041]: finishing. 2024-09-11T01:59:11.137 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35041]: shutting down. 2024-09-11T01:59:11.146 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:11.147 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35043]: starting. 2024-09-11T01:59:11.147 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35043]: listing objects. 2024-09-11T01:59:11.147 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35043]: listed object 0... 2024-09-11T01:59:11.147 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35043]: listed object 25... 2024-09-11T01:59:11.147 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35043]: saw 50 objects 2024-09-11T01:59:11.147 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35043]: shutting down. 2024-09-11T01:59:12.053 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:12.053 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35042]: starting. 2024-09-11T01:59:12.053 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35042]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35006 2024-09-11T01:59:12.053 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35042]: shutting down. 2024-09-11T01:59:12.054 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:12.054 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:12.054 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:12.057 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:59:14.159 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35110]: starting. 2024-09-11T01:59:14.160 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35110]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35109 2024-09-11T01:59:14.160 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35110]: created object 0... 2024-09-11T01:59:14.160 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35110]: created object 25... 2024-09-11T01:59:14.160 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35110]: created object 49... 2024-09-11T01:59:14.160 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35110]: finishing. 2024-09-11T01:59:14.160 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35110]: shutting down. 2024-09-11T01:59:15.088 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35111]: starting. 2024-09-11T01:59:15.088 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35111]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35109 2024-09-11T01:59:15.088 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35111]: shutting down. 2024-09-11T01:59:17.200 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:17.201 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35144]: starting. 2024-09-11T01:59:17.201 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35144]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35109 2024-09-11T01:59:17.201 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35144]: created object 0... 2024-09-11T01:59:17.201 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35144]: created object 25... 2024-09-11T01:59:17.201 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35144]: created object 49... 2024-09-11T01:59:17.201 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35144]: finishing. 2024-09-11T01:59:17.201 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35144]: shutting down. 2024-09-11T01:59:17.211 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:17.211 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35146]: starting. 2024-09-11T01:59:17.212 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35146]: listing objects. 2024-09-11T01:59:17.212 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35146]: listed object 0... 2024-09-11T01:59:17.212 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35146]: listed object 25... 2024-09-11T01:59:17.212 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35146]: saw 50 objects 2024-09-11T01:59:17.212 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35146]: shutting down. 2024-09-11T01:59:18.121 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:18.121 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35145]: starting. 2024-09-11T01:59:18.121 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35145]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35109 2024-09-11T01:59:18.121 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35145]: shutting down. 2024-09-11T01:59:18.122 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:18.122 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:18.122 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:18.124 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:59:20.223 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35213]: starting. 2024-09-11T01:59:20.224 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35213]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35212 2024-09-11T01:59:20.224 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35213]: created object 0... 2024-09-11T01:59:20.224 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35213]: created object 25... 2024-09-11T01:59:20.224 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35213]: created object 49... 2024-09-11T01:59:20.224 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35213]: finishing. 2024-09-11T01:59:20.224 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35213]: shutting down. 2024-09-11T01:59:21.146 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35214]: starting. 2024-09-11T01:59:21.147 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35214]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35212 2024-09-11T01:59:21.147 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35214]: shutting down. 2024-09-11T01:59:22.663 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:22.663 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35247]: starting. 2024-09-11T01:59:22.663 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35247]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35212 2024-09-11T01:59:22.663 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35247]: created object 0... 2024-09-11T01:59:22.663 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35247]: created object 25... 2024-09-11T01:59:22.663 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35247]: created object 49... 2024-09-11T01:59:22.663 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35247]: finishing. 2024-09-11T01:59:22.663 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35247]: shutting down. 2024-09-11T01:59:22.676 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:22.676 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35249]: starting. 2024-09-11T01:59:22.676 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35249]: listing objects. 2024-09-11T01:59:22.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35249]: listed object 0... 2024-09-11T01:59:22.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35249]: listed object 25... 2024-09-11T01:59:22.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35249]: saw 50 objects 2024-09-11T01:59:22.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35249]: shutting down. 2024-09-11T01:59:23.579 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:23.580 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35248]: starting. 2024-09-11T01:59:23.580 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35248]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35212 2024-09-11T01:59:23.580 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35248]: shutting down. 2024-09-11T01:59:23.581 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:23.581 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:23.581 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:23.584 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:59:25.675 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35316]: starting. 2024-09-11T01:59:25.676 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35316]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35315 2024-09-11T01:59:25.676 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35316]: created object 0... 2024-09-11T01:59:25.676 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35316]: created object 25... 2024-09-11T01:59:25.676 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35316]: created object 49... 2024-09-11T01:59:25.676 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35316]: finishing. 2024-09-11T01:59:25.676 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35316]: shutting down. 2024-09-11T01:59:26.584 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35317]: starting. 2024-09-11T01:59:26.584 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35317]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35315 2024-09-11T01:59:26.584 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35317]: shutting down. 2024-09-11T01:59:28.656 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:28.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35350]: starting. 2024-09-11T01:59:28.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35350]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35315 2024-09-11T01:59:28.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35350]: created object 0... 2024-09-11T01:59:28.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35350]: created object 25... 2024-09-11T01:59:28.657 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35350]: created object 49... 2024-09-11T01:59:28.657 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35350]: finishing. 2024-09-11T01:59:28.657 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35350]: shutting down. 2024-09-11T01:59:28.667 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:28.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35352]: starting. 2024-09-11T01:59:28.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35352]: listing objects. 2024-09-11T01:59:28.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35352]: listed object 0... 2024-09-11T01:59:28.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35352]: listed object 25... 2024-09-11T01:59:28.668 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35352]: saw 50 objects 2024-09-11T01:59:28.668 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35352]: shutting down. 2024-09-11T01:59:29.583 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:29.583 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35351]: starting. 2024-09-11T01:59:29.584 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35351]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35315 2024-09-11T01:59:29.584 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35351]: shutting down. 2024-09-11T01:59:29.584 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:29.585 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:29.585 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:29.587 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:59:31.669 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35419]: starting. 2024-09-11T01:59:31.670 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35419]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35418 2024-09-11T01:59:31.670 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35419]: created object 0... 2024-09-11T01:59:31.670 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35419]: created object 25... 2024-09-11T01:59:31.670 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35419]: created object 49... 2024-09-11T01:59:31.670 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35419]: finishing. 2024-09-11T01:59:31.670 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35419]: shutting down. 2024-09-11T01:59:32.590 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35420]: starting. 2024-09-11T01:59:32.590 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35420]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35418 2024-09-11T01:59:32.591 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35420]: shutting down. 2024-09-11T01:59:34.708 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:34.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35453]: starting. 2024-09-11T01:59:34.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35453]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35418 2024-09-11T01:59:34.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35453]: created object 0... 2024-09-11T01:59:34.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35453]: created object 25... 2024-09-11T01:59:34.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35453]: created object 49... 2024-09-11T01:59:34.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35453]: finishing. 2024-09-11T01:59:34.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35453]: shutting down. 2024-09-11T01:59:34.720 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:34.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35455]: starting. 2024-09-11T01:59:34.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35455]: listing objects. 2024-09-11T01:59:34.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35455]: listed object 0... 2024-09-11T01:59:34.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35455]: listed object 25... 2024-09-11T01:59:34.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35455]: saw 50 objects 2024-09-11T01:59:34.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35455]: shutting down. 2024-09-11T01:59:35.622 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:35.622 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35454]: starting. 2024-09-11T01:59:35.622 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35454]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35418 2024-09-11T01:59:35.622 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35454]: shutting down. 2024-09-11T01:59:35.623 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:35.623 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:35.624 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:35.626 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:59:37.661 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35522]: starting. 2024-09-11T01:59:37.662 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35522]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35521 2024-09-11T01:59:37.662 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35522]: created object 0... 2024-09-11T01:59:37.662 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35522]: created object 25... 2024-09-11T01:59:37.662 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35522]: created object 49... 2024-09-11T01:59:37.662 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35522]: finishing. 2024-09-11T01:59:37.662 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35522]: shutting down. 2024-09-11T01:59:38.571 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35523]: starting. 2024-09-11T01:59:38.571 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35523]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35521 2024-09-11T01:59:38.571 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35523]: shutting down. 2024-09-11T01:59:40.666 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:40.666 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35556]: starting. 2024-09-11T01:59:40.666 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35556]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35521 2024-09-11T01:59:40.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35556]: created object 0... 2024-09-11T01:59:40.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35556]: created object 25... 2024-09-11T01:59:40.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35556]: created object 49... 2024-09-11T01:59:40.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35556]: finishing. 2024-09-11T01:59:40.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35556]: shutting down. 2024-09-11T01:59:40.677 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:40.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35558]: starting. 2024-09-11T01:59:40.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35558]: listing objects. 2024-09-11T01:59:40.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35558]: listed object 0... 2024-09-11T01:59:40.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35558]: listed object 25... 2024-09-11T01:59:40.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35558]: saw 50 objects 2024-09-11T01:59:40.678 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35558]: shutting down. 2024-09-11T01:59:41.580 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:41.580 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35557]: starting. 2024-09-11T01:59:41.580 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35557]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35521 2024-09-11T01:59:41.580 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35557]: shutting down. 2024-09-11T01:59:41.581 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:41.581 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:41.581 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:41.584 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:59:43.699 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35625]: starting. 2024-09-11T01:59:43.699 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35625]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35624 2024-09-11T01:59:43.699 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35625]: created object 0... 2024-09-11T01:59:43.699 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35625]: created object 25... 2024-09-11T01:59:43.700 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35625]: created object 49... 2024-09-11T01:59:43.700 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35625]: finishing. 2024-09-11T01:59:43.700 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35625]: shutting down. 2024-09-11T01:59:44.622 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35626]: starting. 2024-09-11T01:59:44.622 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35626]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35624 2024-09-11T01:59:44.622 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35626]: shutting down. 2024-09-11T01:59:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35659]: starting. 2024-09-11T01:59:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35659]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35624 2024-09-11T01:59:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35659]: created object 0... 2024-09-11T01:59:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35659]: created object 25... 2024-09-11T01:59:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35659]: created object 49... 2024-09-11T01:59:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35659]: finishing. 2024-09-11T01:59:46.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35659]: shutting down. 2024-09-11T01:59:46.730 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:46.730 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35661]: starting. 2024-09-11T01:59:46.730 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35661]: listing objects. 2024-09-11T01:59:46.730 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35661]: listed object 0... 2024-09-11T01:59:46.730 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35661]: listed object 25... 2024-09-11T01:59:46.730 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35661]: saw 50 objects 2024-09-11T01:59:46.730 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35661]: shutting down. 2024-09-11T01:59:47.570 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:47.570 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35660]: starting. 2024-09-11T01:59:47.570 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35660]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35624 2024-09-11T01:59:47.571 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35660]: shutting down. 2024-09-11T01:59:47.572 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:47.572 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:47.572 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:47.574 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:59:49.655 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35728]: starting. 2024-09-11T01:59:49.655 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35728]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35727 2024-09-11T01:59:49.655 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35728]: created object 0... 2024-09-11T01:59:49.655 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35728]: created object 25... 2024-09-11T01:59:49.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35728]: created object 49... 2024-09-11T01:59:49.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35728]: finishing. 2024-09-11T01:59:49.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35728]: shutting down. 2024-09-11T01:59:50.581 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35729]: starting. 2024-09-11T01:59:50.581 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35729]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35727 2024-09-11T01:59:50.581 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35729]: shutting down. 2024-09-11T01:59:52.679 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:52.679 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35762]: starting. 2024-09-11T01:59:52.679 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35762]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35727 2024-09-11T01:59:52.679 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35762]: created object 0... 2024-09-11T01:59:52.680 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35762]: created object 25... 2024-09-11T01:59:52.680 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35762]: created object 49... 2024-09-11T01:59:52.680 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35762]: finishing. 2024-09-11T01:59:52.680 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35762]: shutting down. 2024-09-11T01:59:52.690 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:52.690 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35764]: starting. 2024-09-11T01:59:52.690 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35764]: listing objects. 2024-09-11T01:59:52.691 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35764]: listed object 0... 2024-09-11T01:59:52.691 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35764]: listed object 25... 2024-09-11T01:59:52.691 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35764]: saw 50 objects 2024-09-11T01:59:52.691 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35764]: shutting down. 2024-09-11T01:59:53.605 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:53.605 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35763]: starting. 2024-09-11T01:59:53.605 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35763]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35727 2024-09-11T01:59:53.605 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35763]: shutting down. 2024-09-11T01:59:53.606 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:53.606 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:53.606 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:53.609 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T01:59:55.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35831]: starting. 2024-09-11T01:59:55.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35831]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35830 2024-09-11T01:59:55.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35831]: created object 0... 2024-09-11T01:59:55.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35831]: created object 25... 2024-09-11T01:59:55.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35831]: created object 49... 2024-09-11T01:59:55.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35831]: finishing. 2024-09-11T01:59:55.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35831]: shutting down. 2024-09-11T01:59:56.633 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35832]: starting. 2024-09-11T01:59:56.633 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35832]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35830 2024-09-11T01:59:56.634 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35832]: shutting down. 2024-09-11T01:59:58.676 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:58.676 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35865]: starting. 2024-09-11T01:59:58.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35865]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35830 2024-09-11T01:59:58.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35865]: created object 0... 2024-09-11T01:59:58.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35865]: created object 25... 2024-09-11T01:59:58.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35865]: created object 49... 2024-09-11T01:59:58.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35865]: finishing. 2024-09-11T01:59:58.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35865]: shutting down. 2024-09-11T01:59:58.686 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:58.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35867]: starting. 2024-09-11T01:59:58.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35867]: listing objects. 2024-09-11T01:59:58.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35867]: listed object 0... 2024-09-11T01:59:58.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35867]: listed object 25... 2024-09-11T01:59:58.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35867]: saw 50 objects 2024-09-11T01:59:58.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35867]: shutting down. 2024-09-11T01:59:59.583 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:59.584 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35866]: starting. 2024-09-11T01:59:59.584 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35866]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35830 2024-09-11T01:59:59.584 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35866]: shutting down. 2024-09-11T01:59:59.585 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:59.585 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T01:59:59.585 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T01:59:59.587 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:00:01.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35934]: starting. 2024-09-11T02:00:01.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35934]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35933 2024-09-11T02:00:01.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35934]: created object 0... 2024-09-11T02:00:01.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35934]: created object 25... 2024-09-11T02:00:01.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35934]: created object 49... 2024-09-11T02:00:01.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35934]: finishing. 2024-09-11T02:00:01.677 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[35934]: shutting down. 2024-09-11T02:00:02.592 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35935]: starting. 2024-09-11T02:00:02.592 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35935]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35933 2024-09-11T02:00:02.592 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[35935]: shutting down. 2024-09-11T02:00:04.710 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:04.710 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35968]: starting. 2024-09-11T02:00:04.710 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35968]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-35933 2024-09-11T02:00:04.710 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35968]: created object 0... 2024-09-11T02:00:04.710 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35968]: created object 25... 2024-09-11T02:00:04.710 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35968]: created object 49... 2024-09-11T02:00:04.710 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35968]: finishing. 2024-09-11T02:00:04.710 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[35968]: shutting down. 2024-09-11T02:00:04.721 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:04.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35970]: starting. 2024-09-11T02:00:04.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35970]: listing objects. 2024-09-11T02:00:04.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35970]: listed object 0... 2024-09-11T02:00:04.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35970]: listed object 25... 2024-09-11T02:00:04.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35970]: saw 50 objects 2024-09-11T02:00:04.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[35970]: shutting down. 2024-09-11T02:00:05.620 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:05.621 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35969]: starting. 2024-09-11T02:00:05.621 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35969]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-35933 2024-09-11T02:00:05.621 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[35969]: shutting down. 2024-09-11T02:00:05.622 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:05.622 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:05.622 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:00:05.625 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:00:07.651 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36038]: starting. 2024-09-11T02:00:07.652 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36038]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36037 2024-09-11T02:00:07.652 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36038]: created object 0... 2024-09-11T02:00:07.652 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36038]: created object 25... 2024-09-11T02:00:07.652 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36038]: created object 49... 2024-09-11T02:00:07.652 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36038]: finishing. 2024-09-11T02:00:07.652 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36038]: shutting down. 2024-09-11T02:00:08.577 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36039]: starting. 2024-09-11T02:00:08.578 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36039]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36037 2024-09-11T02:00:08.578 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36039]: shutting down. 2024-09-11T02:00:10.671 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:10.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36072]: starting. 2024-09-11T02:00:10.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36072]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36037 2024-09-11T02:00:10.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36072]: created object 0... 2024-09-11T02:00:10.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36072]: created object 25... 2024-09-11T02:00:10.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36072]: created object 49... 2024-09-11T02:00:10.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36072]: finishing. 2024-09-11T02:00:10.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36072]: shutting down. 2024-09-11T02:00:10.682 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:10.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36074]: starting. 2024-09-11T02:00:10.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36074]: listing objects. 2024-09-11T02:00:10.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36074]: listed object 0... 2024-09-11T02:00:10.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36074]: listed object 25... 2024-09-11T02:00:10.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36074]: saw 50 objects 2024-09-11T02:00:10.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36074]: shutting down. 2024-09-11T02:00:11.591 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:11.591 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36073]: starting. 2024-09-11T02:00:11.591 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36073]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36037 2024-09-11T02:00:11.591 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36073]: shutting down. 2024-09-11T02:00:11.594 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:11.594 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:11.594 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:00:11.597 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:00:13.707 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36141]: starting. 2024-09-11T02:00:13.707 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36141]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36140 2024-09-11T02:00:13.707 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36141]: created object 0... 2024-09-11T02:00:13.707 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36141]: created object 25... 2024-09-11T02:00:13.707 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36141]: created object 49... 2024-09-11T02:00:13.708 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36141]: finishing. 2024-09-11T02:00:13.708 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36141]: shutting down. 2024-09-11T02:00:14.627 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36142]: starting. 2024-09-11T02:00:14.627 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36142]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36140 2024-09-11T02:00:14.627 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36142]: shutting down. 2024-09-11T02:00:16.725 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:16.725 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36175]: starting. 2024-09-11T02:00:16.725 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36175]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36140 2024-09-11T02:00:16.725 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36175]: created object 0... 2024-09-11T02:00:16.725 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36175]: created object 25... 2024-09-11T02:00:16.726 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36175]: created object 49... 2024-09-11T02:00:16.726 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36175]: finishing. 2024-09-11T02:00:16.726 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36175]: shutting down. 2024-09-11T02:00:16.735 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:16.736 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36177]: starting. 2024-09-11T02:00:16.736 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36177]: listing objects. 2024-09-11T02:00:16.736 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36177]: listed object 0... 2024-09-11T02:00:16.736 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36177]: listed object 25... 2024-09-11T02:00:16.736 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36177]: saw 50 objects 2024-09-11T02:00:16.736 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36177]: shutting down. 2024-09-11T02:00:17.577 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:17.577 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36176]: starting. 2024-09-11T02:00:17.577 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36176]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36140 2024-09-11T02:00:17.578 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36176]: shutting down. 2024-09-11T02:00:17.579 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:17.579 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:17.579 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:00:17.581 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:00:19.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36244]: starting. 2024-09-11T02:00:19.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36244]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36243 2024-09-11T02:00:19.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36244]: created object 0... 2024-09-11T02:00:19.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36244]: created object 25... 2024-09-11T02:00:19.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36244]: created object 49... 2024-09-11T02:00:19.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36244]: finishing. 2024-09-11T02:00:19.667 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36244]: shutting down. 2024-09-11T02:00:20.587 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36245]: starting. 2024-09-11T02:00:20.587 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36245]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36243 2024-09-11T02:00:20.587 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36245]: shutting down. 2024-09-11T02:00:22.692 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:22.693 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36278]: starting. 2024-09-11T02:00:22.693 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36278]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36243 2024-09-11T02:00:22.693 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36278]: created object 0... 2024-09-11T02:00:22.693 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36278]: created object 25... 2024-09-11T02:00:22.693 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36278]: created object 49... 2024-09-11T02:00:22.693 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36278]: finishing. 2024-09-11T02:00:22.693 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36278]: shutting down. 2024-09-11T02:00:22.703 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:22.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36280]: starting. 2024-09-11T02:00:22.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36280]: listing objects. 2024-09-11T02:00:22.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36280]: listed object 0... 2024-09-11T02:00:22.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36280]: listed object 25... 2024-09-11T02:00:22.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36280]: saw 50 objects 2024-09-11T02:00:22.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36280]: shutting down. 2024-09-11T02:00:23.611 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:23.612 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36279]: starting. 2024-09-11T02:00:23.612 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36279]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36243 2024-09-11T02:00:23.612 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36279]: shutting down. 2024-09-11T02:00:23.613 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:23.613 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:23.613 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:00:23.615 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:00:25.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36347]: starting. 2024-09-11T02:00:25.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36347]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36346 2024-09-11T02:00:25.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36347]: created object 0... 2024-09-11T02:00:25.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36347]: created object 25... 2024-09-11T02:00:25.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36347]: created object 49... 2024-09-11T02:00:25.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36347]: finishing. 2024-09-11T02:00:25.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36347]: shutting down. 2024-09-11T02:00:26.642 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36348]: starting. 2024-09-11T02:00:26.643 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36348]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36346 2024-09-11T02:00:26.643 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36348]: shutting down. 2024-09-11T02:00:28.672 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:28.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36381]: starting. 2024-09-11T02:00:28.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36381]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36346 2024-09-11T02:00:28.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36381]: created object 0... 2024-09-11T02:00:28.673 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36381]: created object 25... 2024-09-11T02:00:28.673 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36381]: created object 49... 2024-09-11T02:00:28.673 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36381]: finishing. 2024-09-11T02:00:28.673 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36381]: shutting down. 2024-09-11T02:00:28.683 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:28.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36383]: starting. 2024-09-11T02:00:28.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36383]: listing objects. 2024-09-11T02:00:28.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36383]: listed object 0... 2024-09-11T02:00:28.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36383]: listed object 25... 2024-09-11T02:00:28.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36383]: saw 50 objects 2024-09-11T02:00:28.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36383]: shutting down. 2024-09-11T02:00:29.582 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:29.582 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36382]: starting. 2024-09-11T02:00:29.582 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36382]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36346 2024-09-11T02:00:29.582 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36382]: shutting down. 2024-09-11T02:00:29.583 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:29.583 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:29.583 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:00:29.586 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:00:31.681 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36450]: starting. 2024-09-11T02:00:31.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36450]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36449 2024-09-11T02:00:31.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36450]: created object 0... 2024-09-11T02:00:31.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36450]: created object 25... 2024-09-11T02:00:31.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36450]: created object 49... 2024-09-11T02:00:31.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36450]: finishing. 2024-09-11T02:00:31.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36450]: shutting down. 2024-09-11T02:00:32.609 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36451]: starting. 2024-09-11T02:00:32.609 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36451]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36449 2024-09-11T02:00:32.609 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36451]: shutting down. 2024-09-11T02:00:33.317 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-09-11T02:00:33.317 INFO:tasks.ceph.mon.e:Restarting daemon 2024-09-11T02:00:33.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-09-11T02:00:33.321 INFO:tasks.ceph.mon.e:Started 2024-09-11T02:00:33.321 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-09-11T02:00:33.321 INFO:tasks.ceph.mon.d:Restarting daemon 2024-09-11T02:00:33.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-09-11T02:00:33.323 INFO:tasks.ceph.mon.d:Started 2024-09-11T02:00:33.323 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-11T02:00:33.324 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-11T02:00:33.324 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-09-11T02:00:33.324 INFO:tasks.ceph.mon.h:Sent signal 19 2024-09-11T02:00:33.324 INFO:tasks.mon_thrash:Sending STOP to mon i 2024-09-11T02:00:33.324 INFO:tasks.ceph.mon.i:Sent signal 19 2024-09-11T02:00:33.324 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T02:00:48.325 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-11T02:00:48.326 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-11T02:00:48.326 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-09-11T02:00:48.326 INFO:tasks.ceph.mon.h:Sent signal 18 2024-09-11T02:00:48.326 INFO:tasks.mon_thrash:Sending CONT to mon i 2024-09-11T02:00:48.326 INFO:tasks.ceph.mon.i:Sent signal 18 2024-09-11T02:00:48.326 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-11T02:00:48.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:00:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.446+0000 7fd67c517640 10 monclient: get_monmap_and_config 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.446+0000 7fd67c517640 10 monclient: build_initial_monmap 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.446+0000 7fd67c517640 10 monclient: monmap: 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:48.447133+0000 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:48.447133+0000 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:48.449 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.446+0000 7fd67c517640 1 Processor -- start 2024-09-11T02:00:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.446+0000 7fd67c517640 1 -- start start 2024-09-11T02:00:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.446+0000 7fd67c517640 10 monclient: init 2024-09-11T02:00:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 10 monclient: _add_conns ranks=[3,5,1,0,8,7,4,2,6] 2024-09-11T02:00:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 10 monclient(hunting): picked mon.noname-g con 0x7fd6741369d0 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 10 monclient(hunting): picked mon.noname-h con 0x7fd674139920 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 10 monclient(hunting): picked mon.noname-f con 0x7fd67413d430 addr v1:172.21.15.203:6789/0 2024-09-11T02:00:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6740a0620 con 0x7fd67413d430 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6740a2d60 con 0x7fd6741369d0 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6741374c0 con 0x7fd674139920 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.447+0000 7fd67c517640 10 monclient(hunting): authenticate will time out at 890.051797s 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd67aab4640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fd67413d430 0x7fd67413f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.73:46362/0 (socket says 172.21.15.73:46362) 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd679ab2640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7fd674139920 0x7fd67413bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.73:47828/0 (socket says 172.21.15.73:47828) 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd67aab4640 1 -- 172.21.15.73:0/4027851075 learned_addr learned my addr 172.21.15.73:0/4027851075 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884434380 0 0) 0x7fd6740a2d60 con 0x7fd6741369d0 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): my global_id is 5061 2024-09-11T02:00:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd660003520 con 0x7fd6741369d0 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464347470 0 0) 0x7fd6740a0620 con 0x7fd67413d430 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): my global_id is 4969 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6740a2d60 con 0x7fd67413d430 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287689278 0 0) 0x7fd6741374c0 con 0x7fd674139920 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient(hunting): my global_id is 5063 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6740a0620 con 0x7fd674139920 2024-09-11T02:00:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1168495213 0 0) 0x7fd660003520 con 0x7fd6741369d0 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 >> v1:172.21.15.203:6791/0 conn(0x7fd674139920 legacy=0x7fd67413bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 >> v1:172.21.15.203:6789/0 conn(0x7fd67413d430 legacy=0x7fd67413f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: _finish_hunting 0 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 monclient: found mon.noname-g 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.203:6790/0 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 --> v1:172.21.15.203:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6740a0fb0 con 0x7fd6741369d0 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: _finish_auth 0 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: _check_auth_tickets 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd670001830 con 0x7fd6741369d0 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: dump: 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd67c517640 5 monclient: authenticate success, global_id 5061 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd67c517640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 <== mon.3 v1:172.21.15.203:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd670001a50 con 0x7fd6741369d0 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd67c517640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd67c517640 4 set_mon_vals no callback set 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 1 -- 172.21.15.73:0/4027851075 <== mon.3 v1:172.21.15.203:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd670001d40 con 0x7fd6741369d0 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.448+0000 7fd6792b1640 10 monclient: dump: 2024-09-11T02:00:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.449+0000 7fd67c517640 10 monclient: shutdown 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.449+0000 7fd67c517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.449+0000 7fd67c517640 1 -- 172.21.15.73:0/4027851075 >> v1:172.21.15.203:6790/0 conn(0x7fd6741369d0 legacy=0x7fd674136db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.449+0000 7fd67c517640 1 -- 172.21.15.73:0/4027851075 shutdown_connections 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.449+0000 7fd67c517640 1 -- 172.21.15.73:0/4027851075 >> 172.21.15.73:0/4027851075 conn(0x7fd6740a7800 msgr2=0x7fd6740a39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.449+0000 7fd67c517640 1 -- 172.21.15.73:0/4027851075 shutdown_connections 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.449+0000 7fd67c517640 1 -- 172.21.15.73:0/4027851075 wait complete. 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 10 monclient: build_initial_monmap 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 10 monclient: monmap: 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 1 Processor -- start 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 1 -- start start 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 10 monclient: init 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 10 monclient: _add_conns ranks=[6,8,5,1,4,7,3,0,2] 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 10 monclient(hunting): picked mon.noname-d con 0x7fd6741369d0 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 10 monclient(hunting): picked mon.noname-e con 0x7fd674139920 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 10 monclient(hunting): picked mon.noname-h con 0x7fd67413d430 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd674120690 con 0x7fd67413d430 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.450+0000 7fd67c517640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd674120970 con 0x7fd6741369d0 2024-09-11T02:00:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6740a64b0 con 0x7fd674139920 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 10 monclient(hunting): authenticate will time out at 890.055037s 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd679ab2640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fd674139920 0x7fd6741d07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38480/0 (socket says 172.21.15.73:38480) 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67a2b3640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fd6741369d0 0x7fd6741cb850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:44674/0 (socket says 172.21.15.73:44674) 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd679ab2640 1 -- 172.21.15.73:0/1552486205 learned_addr learned my addr 172.21.15.73:0/1552486205 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122821724 0 0) 0x7fd6740a64b0 con 0x7fd674139920 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): my global_id is 114110 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd658003520 con 0x7fd674139920 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937075189 0 0) 0x7fd674120970 con 0x7fd6741369d0 2024-09-11T02:00:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): my global_id is 114108 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6740a64b0 con 0x7fd6741369d0 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507224906 0 0) 0x7fd674120690 con 0x7fd67413d430 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): my global_id is 5072 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd674120970 con 0x7fd67413d430 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2754436271 0 0) 0x7fd6740a64b0 con 0x7fd6741369d0 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd674120690 con 0x7fd6741369d0 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3195539425 0 0) 0x7fd658003520 con 0x7fd674139920 2024-09-11T02:00:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6740a64b0 con 0x7fd674139920 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd6700017f0 con 0x7fd6741369d0 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): dump: 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd664001ad0 con 0x7fd674139920 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): dump: 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3269113761 0 0) 0x7fd674120970 con 0x7fd67413d430 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd658003520 con 0x7fd67413d430 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd66c001cb0 con 0x7fd67413d430 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient(hunting): dump: 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.474 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3673753062 0 0) 0x7fd674120690 con 0x7fd6741369d0 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 >> v1:172.21.15.73:6793/0 conn(0x7fd674139920 legacy=0x7fd6741d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 >> v1:172.21.15.203:6791/0 conn(0x7fd67413d430 legacy=0x7fd6741d3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient: _finish_hunting 0 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 monclient: found mon.d 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6741203b0 con 0x7fd6741369d0 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient: _finish_auth 0 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 10 monclient: _check_auth_tickets 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd66affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 5 monclient: authenticate success, global_id 114108 2024-09-11T02:00:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 10 monclient: _renew_subs 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd67411e500 con 0x7fd6741369d0 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 10 monclient: _renew_subs 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.451+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fd6741cbf60 con 0x7fd6741369d0 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd670001990 con 0x7fd6741369d0 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd66affd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd670004060 con 0x7fd6741369d0 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd66affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd66affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd678ab0640 4 set_mon_vals no callback set 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd66affd640 10 monclient: dump: 2024-09-11T02:00:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.478 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fd670004200 con 0x7fd6741369d0 2024-09-11T02:00:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(115..115 src has 1..115) ==== 3506+0+0 (unknown 2197169778 0 0) 0x7fd67004e1c0 con 0x7fd6741369d0 2024-09-11T02:00:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.452+0000 7fd67c517640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.453+0000 7fd67c517640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.453+0000 7fd67c517640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.453+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd65c005080 con 0x7fd6741369d0 2024-09-11T02:00:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.453+0000 7fd679ab2640 10 monclient: get_auth_request con 0x7fd6580406e0 auth_method 0 2024-09-11T02:00:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.457+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fd6700175c0 con 0x7fd6741369d0 2024-09-11T02:00:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.457+0000 7fd66affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.457+0000 7fd66affd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.709+0000 7fd67c517640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:00:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.709+0000 7fd67c517640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:00:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.709+0000 7fd67c517640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.709+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd65c005370 con 0x7fd6741369d0 2024-09-11T02:00:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.709+0000 7fd66affd640 1 -- 172.21.15.73:0/1552486205 <== mon.6 v1:172.21.15.73:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 170099995) 0x7fd670016ec0 con 0x7fd6741369d0 2024-09-11T02:00:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.709+0000 7fd66affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:00:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.709+0000 7fd66affd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:48.711 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":32,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:00:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.711+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 >> v1:172.21.15.203:6812/2311533528 conn(0x7fd6580406e0 legacy=0x7fd658042ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.711+0000 7fd67c517640 10 monclient: shutdown 2024-09-11T02:00:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.711+0000 7fd67c517640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.711+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 >> v1:172.21.15.73:6792/0 conn(0x7fd6741369d0 legacy=0x7fd6741cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.711+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 shutdown_connections 2024-09-11T02:00:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.711+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 >> 172.21.15.73:0/1552486205 conn(0x7fd6740a7800 msgr2=0x7fd67413bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.711+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 shutdown_connections 2024-09-11T02:00:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.711+0000 7fd67c517640 1 -- 172.21.15.73:0/1552486205 wait complete. 2024-09-11T02:00:48.723 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-11T02:00:48.723 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-11T02:00:48.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T02:00:48.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.820+0000 7fe3bfb64640 10 monclient: get_monmap_and_config 2024-09-11T02:00:48.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.820+0000 7fe3bfb64640 10 monclient: build_initial_monmap 2024-09-11T02:00:48.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.820+0000 7fe3bfb64640 10 monclient: monmap: 2024-09-11T02:00:48.822 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:48.822 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.822 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:48.821581+0000 2024-09-11T02:00:48.822 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:48.821581+0000 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:48.823 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.821+0000 7fe3bfb64640 1 Processor -- start 2024-09-11T02:00:48.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.821+0000 7fe3bfb64640 1 -- start start 2024-09-11T02:00:48.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.821+0000 7fe3bfb64640 10 monclient: init 2024-09-11T02:00:48.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.821+0000 7fe3bfb64640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:48.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.821+0000 7fe3bfb64640 10 monclient: _add_conns ranks=[5,2,6,1,4,0,8,7,3] 2024-09-11T02:00:48.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.821+0000 7fe3bfb64640 10 monclient(hunting): picked mon.noname-h con 0x7fe3b8138d40 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:48.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.821+0000 7fe3bfb64640 10 monclient(hunting): picked mon.noname-b con 0x7fe3b80a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.821+0000 7fe3bfb64640 10 monclient(hunting): picked mon.noname-d con 0x7fe3b813f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.821+0000 7fe3bfb64640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b809ca00 con 0x7fe3b80a72f0 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bfb64640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b80a7070 con 0x7fe3b8138d40 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bfb64640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b809cee0 con 0x7fe3b813f350 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bfb64640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bfb64640 10 monclient(hunting): authenticate will time out at 890.426025s 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bd0ff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fe3b80a72f0 0x7fe3b813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:56400/0 (socket says 172.21.15.73:56400) 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3be101640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fe3b813f350 0x7fe3b8141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:44680/0 (socket says 172.21.15.73:44680) 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bd0ff640 1 -- 172.21.15.73:0/3630712059 learned_addr learned my addr 172.21.15.73:0/3630712059 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784786530 0 0) 0x7fe3b809cee0 con 0x7fe3b813f350 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient(hunting): my global_id is 114117 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a4003520 con 0x7fe3b813f350 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2460147802 0 0) 0x7fe3b809ca00 con 0x7fe3b80a72f0 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient(hunting): my global_id is 5078 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b809cee0 con 0x7fe3b80a72f0 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2519842894 0 0) 0x7fe3a4003520 con 0x7fe3b813f350 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 >> v1:172.21.15.203:6791/0 conn(0x7fe3b8138d40 legacy=0x7fe3b8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 >> v1:172.21.15.73:6790/0 conn(0x7fe3b80a72f0 legacy=0x7fe3b813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: _finish_hunting 0 2024-09-11T02:00:48.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 monclient: found mon.noname-d 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b809d1c0 con 0x7fe3b813f350 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: _finish_auth 0 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: _check_auth_tickets 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3b0001bb0 con 0x7fe3b813f350 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bfb64640 5 monclient: authenticate success, global_id 114117 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bfb64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: dump: 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.835 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.836 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bfb64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3b0001d50 con 0x7fe3b813f350 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bfb64640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 1 -- 172.21.15.73:0/3630712059 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3b0004ea0 con 0x7fe3b813f350 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bfb64640 4 set_mon_vals no callback set 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.822+0000 7fe3bc8fe640 10 monclient: dump: 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.837 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.823+0000 7fe3bfb64640 10 monclient: shutdown 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.823+0000 7fe3bfb64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.823+0000 7fe3bfb64640 1 -- 172.21.15.73:0/3630712059 >> v1:172.21.15.73:6792/0 conn(0x7fe3b813f350 legacy=0x7fe3b8141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.823+0000 7fe3bfb64640 1 -- 172.21.15.73:0/3630712059 shutdown_connections 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.823+0000 7fe3bfb64640 1 -- 172.21.15.73:0/3630712059 >> 172.21.15.73:0/3630712059 conn(0x7fe3b80a8050 msgr2=0x7fe3b80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.823+0000 7fe3bfb64640 1 -- 172.21.15.73:0/3630712059 shutdown_connections 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.823+0000 7fe3bfb64640 1 -- 172.21.15.73:0/3630712059 wait complete. 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.823+0000 7fe3bfb64640 10 monclient: build_initial_monmap 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.823+0000 7fe3bfb64640 10 monclient: monmap: 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 1 Processor -- start 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 1 -- start start 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 10 monclient: init 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 10 monclient: _add_conns ranks=[3,0,8,2,7,1,5,4,6] 2024-09-11T02:00:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 10 monclient(hunting): picked mon.noname-g con 0x7fe3b80a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 10 monclient(hunting): picked mon.noname-a con 0x7fe3b8138d40 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 10 monclient(hunting): picked mon.noname-e con 0x7fe3b813f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b8140550 con 0x7fe3b8138d40 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b8141420 con 0x7fe3b80a72f0 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b80a1810 con 0x7fe3b813f350 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bfb64640 10 monclient(hunting): authenticate will time out at 890.428775s 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bd0ff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe3b8138d40 0x7fe3b813fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51852/0 (socket says 172.21.15.73:51852) 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3be101640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fe3b813f350 0x7fe3b81d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38488/0 (socket says 172.21.15.73:38488) 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.824+0000 7fe3bd0ff640 1 -- 172.21.15.73:0/1346207785 learned_addr learned my addr 172.21.15.73:0/1346207785 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051363695 0 0) 0x7fe3b8140550 con 0x7fe3b8138d40 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): my global_id is 5220 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe39c003550 con 0x7fe3b8138d40 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2579553960 0 0) 0x7fe3b80a1810 con 0x7fe3b813f350 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): my global_id is 114119 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b8140550 con 0x7fe3b813f350 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566609127 0 0) 0x7fe3b8141420 con 0x7fe3b80a72f0 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): my global_id is 5070 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b80a1810 con 0x7fe3b80a72f0 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3898921729 0 0) 0x7fe3b8140550 con 0x7fe3b813f350 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3b8141420 con 0x7fe3b813f350 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3b0001a70 con 0x7fe3b813f350 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): dump: 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.843 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3657498411 0 0) 0x7fe39c003550 con 0x7fe3b8138d40 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3b8140550 con 0x7fe3b8138d40 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3a8001590 con 0x7fe3b8138d40 2024-09-11T02:00:48.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): dump: 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 639104211 0 0) 0x7fe3b80a1810 con 0x7fe3b80a72f0 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe39c003550 con 0x7fe3b80a72f0 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3b4001ad0 con 0x7fe3b80a72f0 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient(hunting): dump: 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3522199810 0 0) 0x7fe3b8141420 con 0x7fe3b813f350 2024-09-11T02:00:48.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 >> v1:172.21.15.203:6790/0 conn(0x7fe3b80a72f0 legacy=0x7fe3b813f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 >> v1:172.21.15.73:6789/0 conn(0x7fe3b8138d40 legacy=0x7fe3b813fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 monclient: found mon.e 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b8141da0 con 0x7fe3b813f350 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient: _finish_auth 0 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3bfb64640 5 monclient: authenticate success, global_id 114119 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3bfb64640 10 monclient: _renew_subs 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3bfb64640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b8140e40 con 0x7fe3b813f350 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3bfb64640 10 monclient: _renew_subs 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3bfb64640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3b813e7e0 con 0x7fe3b813f350 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3b0001c90 con 0x7fe3b813f350 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3b0005150 con 0x7fe3b813f350 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3affff640 4 set_mon_vals no callback set 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.825+0000 7fe3ae7fc640 10 monclient: dump: 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3bfb64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe3a00065c0 con 0x7fe3a0002860 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fe3b0011890 con 0x7fe3b813f350 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 4136420502 0 0) 0x7fe3b004e480 con 0x7fe3b813f350 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254027684 0 0) 0x7fe3a00065c0 con 0x7fe3a0002860 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3ae7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3ae7fc640 10 monclient(hunting): my global_id is 5229 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b8141420 con 0x7fe3a0002860 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.826+0000 7fe3bd0ff640 10 monclient: get_auth_request con 0x7fe39c040740 auth_method 0 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2577156535 0 0) 0x7fe3b8141420 con 0x7fe3a0002860 2024-09-11T02:00:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3a00065c0 con 0x7fe3a0002860 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3b4003930 con 0x7fe3a0002860 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 10 monclient: dump: 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 141123264 0 0) 0x7fe3a00065c0 con 0x7fe3a0002860 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3a000a160 con 0x7fe3a0002860 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe3b4003d30 con 0x7fe3a0002860 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 >> v1:172.21.15.73:6789/0 conn(0x7fe3a0002860 legacy=0x7fe3a0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.827+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 >> v1:172.21.15.73:6789/0 conn(0x7fe3a0002860 legacy=0x7fe3a0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.833+0000 7fe3bfb64640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.833+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe3a0009e50 con 0x7fe3a0009110 2024-09-11T02:00:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954425906 0 0) 0x7fe3a0009e50 con 0x7fe3a0009110 2024-09-11T02:00:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 10 monclient(hunting): my global_id is 5238 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a00065c0 con 0x7fe3a0009110 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1987310865 0 0) 0x7fe3a00065c0 con 0x7fe3a0009110 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3a0009e50 con 0x7fe3a0009110 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3b40044d0 con 0x7fe3a0009110 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 10 monclient: dump: 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1649922512 0 0) 0x7fe3a0009e50 con 0x7fe3a0009110 2024-09-11T02:00:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 --> v1:172.21.15.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3a000c3f0 con 0x7fe3a0009110 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 2330043427) 0x7fe3b40059e0 con 0x7fe3a0009110 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 >> v1:172.21.15.73:6789/0 conn(0x7fe3a0009110 legacy=0x7fe3a00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3ae7fc640 1 -- 172.21.15.73:0/1346207785 >> v1:172.21.15.73:6789/0 conn(0x7fe3a0009110 legacy=0x7fe3a00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:48.858 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 171274, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:48.859 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:48.860 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:48.861 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:48.862 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:48.863 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:48.864 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:48.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:48.866 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:48.867 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:48.868 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:48.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:48.870 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:48.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:48.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:48.878 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 >> v1:172.21.15.203:6812/2311533528 conn(0x7fe39c040740 legacy=0x7fe39c042c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3bfb64640 10 monclient: shutdown 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3bfb64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 >> v1:172.21.15.73:6793/0 conn(0x7fe3b813f350 legacy=0x7fe3b81d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3be101640 1 -- 172.21.15.73:0/1346207785 reap_dead start 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3be101640 1 -- 172.21.15.73:0/1346207785 reap_dead start 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 shutdown_connections 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.834+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 >> 172.21.15.73:0/1346207785 conn(0x7fe3b80a8050 msgr2=0x7fe3b8131a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.835+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 shutdown_connections 2024-09-11T02:00:48.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.835+0000 7fe3bfb64640 1 -- 172.21.15.73:0/1346207785 wait complete. 2024-09-11T02:00:48.881 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:48.881 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-11T02:00:48.881 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T02:00:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.977+0000 7f6239124640 10 monclient: get_monmap_and_config 2024-09-11T02:00:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.977+0000 7f6239124640 10 monclient: build_initial_monmap 2024-09-11T02:00:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.977+0000 7f6239124640 10 monclient: monmap: 2024-09-11T02:00:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:48.978199+0000 2024-09-11T02:00:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:48.978199+0000 2024-09-11T02:00:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:48.999 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.000 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.977+0000 7f6239124640 1 Processor -- start 2024-09-11T02:00:49.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.977+0000 7f6239124640 1 -- start start 2024-09-11T02:00:49.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.977+0000 7f6239124640 10 monclient: init 2024-09-11T02:00:49.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 10 monclient: _add_conns ranks=[4,0,5,6,1,3,8,2,7] 2024-09-11T02:00:49.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 10 monclient(hunting): picked mon.noname-c con 0x7f6234138e40 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:49.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 10 monclient(hunting): picked mon.noname-a con 0x7f6234139220 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:49.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 10 monclient(hunting): picked mon.noname-h con 0x7f623413f250 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:49.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623409d190 con 0x7f6234139220 2024-09-11T02:00:49.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623409e280 con 0x7f6234138e40 2024-09-11T02:00:49.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623409ceb0 con 0x7f623413f250 2024-09-11T02:00:49.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6239124640 10 monclient(hunting): authenticate will time out at 890.582502s 2024-09-11T02:00:49.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6232d9d640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f6234138e40 0x7f623409db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49416/0 (socket says 172.21.15.73:49416) 2024-09-11T02:00:49.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f623259c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6234139220 0x7f623413db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51880/0 (socket says 172.21.15.73:51880) 2024-09-11T02:00:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6232d9d640 1 -- 172.21.15.73:0/3916553204 learned_addr learned my addr 172.21.15.73:0/3916553204 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636697989 0 0) 0x7f621c001110 con 0x7f6234139220 2024-09-11T02:00:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 10 monclient(hunting): my global_id is 5247 2024-09-11T02:00:49.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6220003520 con 0x7f6234139220 2024-09-11T02:00:49.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892648555 0 0) 0x7f623409e280 con 0x7f6234138e40 2024-09-11T02:00:49.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 10 monclient(hunting): my global_id is 4981 2024-09-11T02:00:49.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.978+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f621c001110 con 0x7f6234138e40 2024-09-11T02:00:49.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2286039842 0 0) 0x7f621c001110 con 0x7f6234138e40 2024-09-11T02:00:49.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 >> v1:172.21.15.203:6791/0 conn(0x7f623413f250 legacy=0x7f6234141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 >> v1:172.21.15.73:6789/0 conn(0x7f6234139220 legacy=0x7f623413db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 1 monclient: found mon.noname-c 2024-09-11T02:00:49.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:00:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623409d470 con 0x7f6234138e40 2024-09-11T02:00:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 5 monclient: authenticate success, global_id 4981 2024-09-11T02:00:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6224001810 con 0x7f6234138e40 2024-09-11T02:00:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: dump: 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62240019b0 con 0x7f6234138e40 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 1 -- 172.21.15.73:0/3916553204 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6224004be0 con 0x7f6234138e40 2024-09-11T02:00:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 4 set_mon_vals no callback set 2024-09-11T02:00:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6231d9b640 10 monclient: dump: 2024-09-11T02:00:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.011 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 10 monclient: shutdown 2024-09-11T02:00:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 1 -- 172.21.15.73:0/3916553204 >> v1:172.21.15.73:6791/0 conn(0x7f6234138e40 legacy=0x7f623409db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 1 -- 172.21.15.73:0/3916553204 shutdown_connections 2024-09-11T02:00:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 1 -- 172.21.15.73:0/3916553204 >> 172.21.15.73:0/3916553204 conn(0x7f62340abe10 msgr2=0x7f62340a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 1 -- 172.21.15.73:0/3916553204 shutdown_connections 2024-09-11T02:00:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.979+0000 7f6239124640 1 -- 172.21.15.73:0/3916553204 wait complete. 2024-09-11T02:00:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.980+0000 7f6239124640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.980+0000 7f6239124640 10 monclient: monmap: 2024-09-11T02:00:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.015 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.980+0000 7f6239124640 1 Processor -- start 2024-09-11T02:00:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.980+0000 7f6239124640 1 -- start start 2024-09-11T02:00:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.980+0000 7f6239124640 10 monclient: init 2024-09-11T02:00:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 10 monclient: _add_conns ranks=[3,7,0,6,1,2,8,5,4] 2024-09-11T02:00:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 10 monclient(hunting): picked mon.noname-g con 0x7f6234138e40 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 10 monclient(hunting): picked mon.noname-i con 0x7f6234139220 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 10 monclient(hunting): picked mon.noname-a con 0x7f623413f250 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62340a4e50 con 0x7f623413f250 2024-09-11T02:00:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623413a6b0 con 0x7f6234138e40 2024-09-11T02:00:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623413a990 con 0x7f6234139220 2024-09-11T02:00:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f6239124640 10 monclient(hunting): authenticate will time out at 890.585425s 2024-09-11T02:00:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f623359e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f623413f250 0x7f62340a3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51888/0 (socket says 172.21.15.73:51888) 2024-09-11T02:00:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f623359e640 1 -- 172.21.15.73:0/2868165714 learned_addr learned my addr 172.21.15.73:0/2868165714 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117819917 0 0) 0x7f62340a4e50 con 0x7f623413f250 2024-09-11T02:00:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 10 monclient(hunting): my global_id is 5256 2024-09-11T02:00:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6214003520 con 0x7f623413f250 2024-09-11T02:00:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 714262467 0 0) 0x7f6214003520 con 0x7f623413f250 2024-09-11T02:00:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62340a4e50 con 0x7f623413f250 2024-09-11T02:00:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f622c001db0 con 0x7f623413f250 2024-09-11T02:00:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:00:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 10 monclient(hunting): dump: 2024-09-11T02:00:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.022 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.981+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415764630 0 0) 0x7f623413a6b0 con 0x7f6234138e40 2024-09-11T02:00:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient(hunting): my global_id is 5079 2024-09-11T02:00:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6214003520 con 0x7f6234138e40 2024-09-11T02:00:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900529102 0 0) 0x7f623413a990 con 0x7f6234139220 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient(hunting): my global_id is 5002 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f623413a6b0 con 0x7f6234139220 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3039039901 0 0) 0x7f62340a4e50 con 0x7f623413f250 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 >> v1:172.21.15.203:6792/0 conn(0x7f6234139220 legacy=0x7f62340a33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 >> v1:172.21.15.203:6790/0 conn(0x7f6234138e40 legacy=0x7f62340a2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 monclient: found mon.a 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:00:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623413ac70 con 0x7f623413f250 2024-09-11T02:00:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f6239124640 5 monclient: authenticate success, global_id 5256 2024-09-11T02:00:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f6239124640 10 monclient: _renew_subs 2024-09-11T02:00:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f6239124640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:00:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f623413a3d0 con 0x7f623413f250 2024-09-11T02:00:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f6239124640 10 monclient: _renew_subs 2024-09-11T02:00:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f6239124640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:00:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f62341d6cb0 con 0x7f623413f250 2024-09-11T02:00:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f622c003c40 con 0x7f623413f250 2024-09-11T02:00:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f622c004230 con 0x7f623413f250 2024-09-11T02:00:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f623159a640 4 set_mon_vals no callback set 2024-09-11T02:00:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f622b7fe640 10 monclient: dump: 2024-09-11T02:00:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.029 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f6239124640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.982+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62180065c0 con 0x7f6218002860 2024-09-11T02:00:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f622c004450 con 0x7f623413f250 2024-09-11T02:00:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 4136420502 0 0) 0x7f622c04e690 con 0x7f623413f250 2024-09-11T02:00:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792158789 0 0) 0x7f62180065c0 con 0x7f6218002860 2024-09-11T02:00:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 10 monclient(hunting): my global_id is 5087 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62340a4e50 con 0x7f6218002860 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f623259c640 10 monclient: get_auth_request con 0x7f621403fee0 auth_method 0 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1380439244 0 0) 0x7f62340a4e50 con 0x7f6218002860 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62180065c0 con 0x7f6218002860 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6224001590 con 0x7f6218002860 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 10 monclient: dump: 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.031 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1147534270 0 0) 0x7f62180065c0 con 0x7f6218002860 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.983+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f621800a160 con 0x7f6218002860 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.984+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f62240017b0 con 0x7f6218002860 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.984+0000 7f622b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.984+0000 7f622b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.984+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 >> v1:172.21.15.73:6790/0 conn(0x7f6218002860 legacy=0x7f6218004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.984+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 >> v1:172.21.15.73:6790/0 conn(0x7f6218002860 legacy=0x7f6218004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f6239124640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6218009e70 con 0x7f6218009130 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024393951 0 0) 0x7f6218009e70 con 0x7f6218009130 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 10 monclient(hunting): my global_id is 5096 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62180065c0 con 0x7f6218009130 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2153584569 0 0) 0x7f62180065c0 con 0x7f6218009130 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6218009e70 con 0x7f6218009130 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6224001c90 con 0x7f6218009130 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 10 monclient: dump: 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2148214440 0 0) 0x7f6218009e70 con 0x7f6218009130 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 --> v1:172.21.15.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f621800c410 con 0x7f6218009130 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7880 (unknown 0 0 535556079) 0x7f6224005340 con 0x7f6218009130 2024-09-11T02:00:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 >> v1:172.21.15.73:6790/0 conn(0x7f6218009130 legacy=0x7f62180095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.990+0000 7f622b7fe640 1 -- 172.21.15.73:0/2868165714 >> v1:172.21.15.73:6790/0 conn(0x7f6218009130 legacy=0x7f62180095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 171448, 2024-09-11T02:00:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.047 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.057 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:49.057 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 >> v1:172.21.15.203:6812/2311533528 conn(0x7f621403fee0 legacy=0x7f62140423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f6239124640 10 monclient: shutdown 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f6239124640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 >> v1:172.21.15.73:6789/0 conn(0x7f623413f250 legacy=0x7f62340a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f623359e640 1 -- 172.21.15.73:0/2868165714 reap_dead start 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f623359e640 1 -- 172.21.15.73:0/2868165714 reap_dead start 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 shutdown_connections 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 >> 172.21.15.73:0/2868165714 conn(0x7f62340abe10 msgr2=0x7f62340a63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 shutdown_connections 2024-09-11T02:00:49.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:48.991+0000 7f6239124640 1 -- 172.21.15.73:0/2868165714 wait complete. 2024-09-11T02:00:49.060 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:49.060 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-11T02:00:49.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.156+0000 7fe3adb17640 10 monclient: get_monmap_and_config 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.156+0000 7fe3adb17640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.156+0000 7fe3adb17640 10 monclient: monmap: 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:49.157176+0000 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:49.157176+0000 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.159 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 1 Processor -- start 2024-09-11T02:00:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 1 -- start start 2024-09-11T02:00:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 10 monclient: init 2024-09-11T02:00:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 10 monclient: _add_conns ranks=[2,5,8,7,0,6,1,4,3] 2024-09-11T02:00:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 10 monclient(hunting): picked mon.noname-b con 0x7fe3a80a5ba0 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 10 monclient(hunting): picked mon.noname-h con 0x7fe3a809db00 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 10 monclient(hunting): picked mon.noname-e con 0x7fe3a80a6690 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80a7a50 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a806fb30 con 0x7fe3a809db00 2024-09-11T02:00:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a809ce40 con 0x7fe3a80a6690 2024-09-11T02:00:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3adb17640 10 monclient(hunting): authenticate will time out at 890.761686s 2024-09-11T02:00:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3a77fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fe3a80a5ba0 0x7fe3a80a5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:56434/0 (socket says 172.21.15.73:56434) 2024-09-11T02:00:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.157+0000 7fe3a77fe640 1 -- 172.21.15.73:0/3834739758 learned_addr learned my addr 172.21.15.73:0/3834739758 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080536271 0 0) 0x7fe3a80a7a50 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient(hunting): my global_id is 5105 2024-09-11T02:00:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe394003520 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 159478220 0 0) 0x7fe3a809ce40 con 0x7fe3a80a6690 2024-09-11T02:00:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient(hunting): my global_id is 114128 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a80a7a50 con 0x7fe3a80a6690 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1164199477 0 0) 0x7fe394003520 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 >> v1:172.21.15.73:6793/0 conn(0x7fe3a80a6690 legacy=0x7fe3a81414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 >> v1:172.21.15.203:6791/0 conn(0x7fe3a809db00 legacy=0x7fe3a813ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 monclient: found mon.noname-b 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80a7440 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe398001830 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 5 monclient: authenticate success, global_id 5105 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: dump: 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe398001a50 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 1 -- 172.21.15.73:0/3834739758 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe398001cc0 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 4 set_mon_vals no callback set 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3a6ffd640 10 monclient: dump: 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 10 monclient: shutdown 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 1 -- 172.21.15.73:0/3834739758 >> v1:172.21.15.73:6790/0 conn(0x7fe3a80a5ba0 legacy=0x7fe3a80a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 1 -- 172.21.15.73:0/3834739758 shutdown_connections 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 1 -- 172.21.15.73:0/3834739758 >> 172.21.15.73:0/3834739758 conn(0x7fe3a80a7e80 msgr2=0x7fe3a80a8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 1 -- 172.21.15.73:0/3834739758 shutdown_connections 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.158+0000 7fe3adb17640 1 -- 172.21.15.73:0/3834739758 wait complete. 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.159+0000 7fe3adb17640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.159+0000 7fe3adb17640 10 monclient: monmap: 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.159+0000 7fe3adb17640 1 Processor -- start 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 1 -- start start 2024-09-11T02:00:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 10 monclient: init 2024-09-11T02:00:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 10 monclient: _add_conns ranks=[6,7,2,0,3,1,4,5,8] 2024-09-11T02:00:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 10 monclient(hunting): picked mon.noname-d con 0x7fe3a809db00 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 10 monclient(hunting): picked mon.noname-i con 0x7fe3a80a5ba0 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 10 monclient(hunting): picked mon.noname-b con 0x7fe3a80a6690 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a8126250 con 0x7fe3a80a6690 2024-09-11T02:00:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a8126530 con 0x7fe3a809db00 2024-09-11T02:00:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80a5560 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3adb17640 10 monclient(hunting): authenticate will time out at 890.764510s 2024-09-11T02:00:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a77fe640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fe3a809db00 0x7fe3a8138b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:44686/0 (socket says 172.21.15.73:44686) 2024-09-11T02:00:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a7fff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fe3a80a6690 0x7fe3a81d5970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:56444/0 (socket says 172.21.15.73:56444) 2024-09-11T02:00:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a77fe640 1 -- 172.21.15.73:0/2004034741 learned_addr learned my addr 172.21.15.73:0/2004034741 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806471048 0 0) 0x7fe3a8126250 con 0x7fe3a80a6690 2024-09-11T02:00:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): my global_id is 5114 2024-09-11T02:00:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe388003520 con 0x7fe3a80a6690 2024-09-11T02:00:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915188478 0 0) 0x7fe3a8126530 con 0x7fe3a809db00 2024-09-11T02:00:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): my global_id is 114126 2024-09-11T02:00:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a8126250 con 0x7fe3a809db00 2024-09-11T02:00:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412923380 0 0) 0x7fe3a80a5560 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 10 monclient(hunting): my global_id is 5011 2024-09-11T02:00:49.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a8126530 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.160+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3687770455 0 0) 0x7fe388003520 con 0x7fe3a80a6690 2024-09-11T02:00:49.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3a80a5560 con 0x7fe3a80a6690 2024-09-11T02:00:49.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3a0001cd0 con 0x7fe3a80a6690 2024-09-11T02:00:49.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:00:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): dump: 2024-09-11T02:00:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.196 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 521552572 0 0) 0x7fe3a8126250 con 0x7fe3a809db00 2024-09-11T02:00:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe388003520 con 0x7fe3a809db00 2024-09-11T02:00:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3980017f0 con 0x7fe3a809db00 2024-09-11T02:00:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:49.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): dump: 2024-09-11T02:00:49.197 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.197 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.197 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.198 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.198 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.198 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.198 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.198 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.200 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.200 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1124693198 0 0) 0x7fe3a8126530 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3a8126250 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe390001a10 con 0x7fe3a80a5ba0 2024-09-11T02:00:49.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:00:49.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient(hunting): dump: 2024-09-11T02:00:49.201 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.201 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.201 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.201 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.202 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.202 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.202 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.202 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.202 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.202 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.203 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.203 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.203 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.203 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.203 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.203 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1952190197 0 0) 0x7fe3a80a5560 con 0x7fe3a80a6690 2024-09-11T02:00:49.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 >> v1:172.21.15.203:6792/0 conn(0x7fe3a80a5ba0 legacy=0x7fe3a81d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 >> v1:172.21.15.73:6792/0 conn(0x7fe3a809db00 legacy=0x7fe3a8138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 monclient: found mon.b 2024-09-11T02:00:49.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:00:49.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80a1f00 con 0x7fe3a80a6690 2024-09-11T02:00:49.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3adb17640 5 monclient: authenticate success, global_id 5114 2024-09-11T02:00:49.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3adb17640 10 monclient: _renew_subs 2024-09-11T02:00:49.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3adb17640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:00:49.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a8125f70 con 0x7fe3a80a6690 2024-09-11T02:00:49.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3adb17640 10 monclient: _renew_subs 2024-09-11T02:00:49.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3adb17640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:00:49.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3a8139280 con 0x7fe3a80a6690 2024-09-11T02:00:49.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3a0003970 con 0x7fe3a80a6690 2024-09-11T02:00:49.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3a0003ea0 con 0x7fe3a80a6690 2024-09-11T02:00:49.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a67fc640 4 set_mon_vals no callback set 2024-09-11T02:00:49.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.161+0000 7fe3a4ff9640 10 monclient: dump: 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.208 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.209 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.209 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.209 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.209 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.209 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3adb17640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe38c0065c0 con 0x7fe38c002860 2024-09-11T02:00:49.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fe3a00040c0 con 0x7fe3a80a6690 2024-09-11T02:00:49.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 4136420502 0 0) 0x7fe3a004e4f0 con 0x7fe3a80a6690 2024-09-11T02:00:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788625800 0 0) 0x7fe38c0065c0 con 0x7fe38c002860 2024-09-11T02:00:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 10 monclient(hunting): my global_id is 4990 2024-09-11T02:00:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a80a5560 con 0x7fe38c002860 2024-09-11T02:00:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe39effd640 10 monclient: get_auth_request con 0x7fe388040650 auth_method 0 2024-09-11T02:00:49.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1956718594 0 0) 0x7fe3a80a5560 con 0x7fe38c002860 2024-09-11T02:00:49.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe38c0065c0 con 0x7fe38c002860 2024-09-11T02:00:49.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe398004fc0 con 0x7fe38c002860 2024-09-11T02:00:49.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:49.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.162+0000 7fe3a4ff9640 10 monclient: dump: 2024-09-11T02:00:49.212 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.212 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.212 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.212 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.212 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.163+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 343808180 0 0) 0x7fe38c0065c0 con 0x7fe38c002860 2024-09-11T02:00:49.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.163+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe38c00a160 con 0x7fe38c002860 2024-09-11T02:00:49.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.163+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe398005160 con 0x7fe38c002860 2024-09-11T02:00:49.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.163+0000 7fe3a4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.163+0000 7fe3a4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:49.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.163+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 >> v1:172.21.15.73:6791/0 conn(0x7fe38c002860 legacy=0x7fe38c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.163+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 >> v1:172.21.15.73:6791/0 conn(0x7fe38c002860 legacy=0x7fe38c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3adb17640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:49.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe38c009e70 con 0x7fe38c009130 2024-09-11T02:00:49.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089181788 0 0) 0x7fe38c009e70 con 0x7fe38c009130 2024-09-11T02:00:49.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 10 monclient(hunting): my global_id is 4999 2024-09-11T02:00:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe38c0065c0 con 0x7fe38c009130 2024-09-11T02:00:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2043569337 0 0) 0x7fe38c0065c0 con 0x7fe38c009130 2024-09-11T02:00:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe38c009e70 con 0x7fe38c009130 2024-09-11T02:00:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe398005940 con 0x7fe38c009130 2024-09-11T02:00:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.169+0000 7fe3a4ff9640 10 monclient: dump: 2024-09-11T02:00:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.218 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.219 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.219 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.219 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.219 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.219 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.220 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.220 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.220 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.220 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.220 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3957861644 0 0) 0x7fe38c009e70 con 0x7fe38c009130 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 --> v1:172.21.15.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe38c00c410 con 0x7fe38c009130 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3012624288) 0x7fe398007ee0 con 0x7fe38c009130 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3a4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3a4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 >> v1:172.21.15.73:6791/0 conn(0x7fe38c009130 legacy=0x7fe38c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3a4ff9640 1 -- 172.21.15.73:0/2004034741 >> v1:172.21.15.73:6791/0 conn(0x7fe38c009130 legacy=0x7fe38c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.222 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 171633, 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.232 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:49.234 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.235 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.236 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:49.237 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:49.238 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.239 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.240 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:49.241 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.242 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.243 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:49.244 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:49.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 >> v1:172.21.15.203:6812/2311533528 conn(0x7fe388040650 legacy=0x7fe388042b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3adb17640 10 monclient: shutdown 2024-09-11T02:00:49.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3adb17640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 >> v1:172.21.15.73:6790/0 conn(0x7fe3a80a6690 legacy=0x7fe3a81d5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3a7fff640 1 -- 172.21.15.73:0/2004034741 reap_dead start 2024-09-11T02:00:49.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3a7fff640 1 -- 172.21.15.73:0/2004034741 reap_dead start 2024-09-11T02:00:49.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 shutdown_connections 2024-09-11T02:00:49.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 >> 172.21.15.73:0/2004034741 conn(0x7fe3a80a7e80 msgr2=0x7fe3a80a4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 shutdown_connections 2024-09-11T02:00:49.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.170+0000 7fe3adb17640 1 -- 172.21.15.73:0/2004034741 wait complete. 2024-09-11T02:00:49.247 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:49.247 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-11T02:00:49.248 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-11T02:00:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.344+0000 7fc300618640 10 monclient: get_monmap_and_config 2024-09-11T02:00:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.344+0000 7fc300618640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.345+0000 7fc300618640 10 monclient: monmap: 2024-09-11T02:00:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.346 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:49.345850+0000 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:49.345850+0000 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.347 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.348 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.345+0000 7fc300618640 1 Processor -- start 2024-09-11T02:00:49.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.345+0000 7fc300618640 1 -- start start 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.345+0000 7fc300618640 10 monclient: init 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 10 monclient: _add_conns ranks=[2,5,8,1,7,0,4,6,3] 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 10 monclient(hunting): picked mon.noname-b con 0x7fc2f8138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 10 monclient(hunting): picked mon.noname-h con 0x7fc2f80a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 10 monclient(hunting): picked mon.noname-e con 0x7fc2f813f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f809ca00 con 0x7fc2f8138d40 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f80a7070 con 0x7fc2f80a72f0 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f809cee0 con 0x7fc2f813f350 2024-09-11T02:00:49.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc300618640 10 monclient(hunting): authenticate will time out at 890.950416s 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fe3b4640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fc2f8138d40 0x7fc2f8139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:56454/0 (socket says 172.21.15.73:56454) 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fe3b4640 1 -- 172.21.15.73:0/264585118 learned_addr learned my addr 172.21.15.73:0/264585118 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2febb5640 1 --1- 172.21.15.73:0/264585118 >> v1:172.21.15.73:6793/0 conn(0x7fc2f813f350 0x7fc2f8141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38500/0 (socket says 172.21.15.73:38500) 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006078709 0 0) 0x7fc2f809cee0 con 0x7fc2f813f350 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): my global_id is 114137 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2e4003520 con 0x7fc2f813f350 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481817213 0 0) 0x7fc2f809ca00 con 0x7fc2f8138d40 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): my global_id is 5123 2024-09-11T02:00:49.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2f809cee0 con 0x7fc2f8138d40 2024-09-11T02:00:49.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337141863 0 0) 0x7fc2f80a7070 con 0x7fc2f80a72f0 2024-09-11T02:00:49.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient(hunting): my global_id is 5108 2024-09-11T02:00:49.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2f809ca00 con 0x7fc2f80a72f0 2024-09-11T02:00:49.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3199302962 0 0) 0x7fc2e4003520 con 0x7fc2f813f350 2024-09-11T02:00:49.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 >> v1:172.21.15.203:6791/0 conn(0x7fc2f80a72f0 legacy=0x7fc2f813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 >> v1:172.21.15.73:6790/0 conn(0x7fc2f8138d40 legacy=0x7fc2f8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 monclient: found mon.noname-e 2024-09-11T02:00:49.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:00:49.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f809d1c0 con 0x7fc2f813f350 2024-09-11T02:00:49.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc2f0001bb0 con 0x7fc2f813f350 2024-09-11T02:00:49.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.346+0000 7fc2fd3b2640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc2fd3b2640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc2fd3b2640 10 monclient: dump: 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.362 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 5 monclient: authenticate success, global_id 114137 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc2f0001dd0 con 0x7fc2f813f350 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc2fd3b2640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc2fd3b2640 1 -- 172.21.15.73:0/264585118 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc2f0004ea0 con 0x7fc2f813f350 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc2fd3b2640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 4 set_mon_vals no callback set 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc2fd3b2640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc2fd3b2640 10 monclient: dump: 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.364 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 10 monclient: shutdown 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 1 -- 172.21.15.73:0/264585118 >> v1:172.21.15.73:6793/0 conn(0x7fc2f813f350 legacy=0x7fc2f8141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 1 -- 172.21.15.73:0/264585118 shutdown_connections 2024-09-11T02:00:49.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 1 -- 172.21.15.73:0/264585118 >> 172.21.15.73:0/264585118 conn(0x7fc2f80a8050 msgr2=0x7fc2f80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 1 -- 172.21.15.73:0/264585118 shutdown_connections 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.347+0000 7fc300618640 1 -- 172.21.15.73:0/264585118 wait complete. 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.348+0000 7fc300618640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.348+0000 7fc300618640 10 monclient: monmap: 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.366 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.348+0000 7fc300618640 1 Processor -- start 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.348+0000 7fc300618640 1 -- start start 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.348+0000 7fc300618640 10 monclient: init 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient: _add_conns ranks=[5,3,4,2,1,7,6,0,8] 2024-09-11T02:00:49.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient(hunting): picked mon.noname-h con 0x7fc2f80a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient(hunting): picked mon.noname-g con 0x7fc2f8138d40 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient(hunting): picked mon.noname-c con 0x7fc2f813f350 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f813c590 con 0x7fc2f8138d40 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f813c870 con 0x7fc2f813f350 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f813e780 con 0x7fc2f80a72f0 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient(hunting): authenticate will time out at 890.953133s 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2febb5640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fc2f813f350 0x7fc2f81d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49448/0 (socket says 172.21.15.73:49448) 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2febb5640 1 -- 172.21.15.73:0/3342288306 learned_addr learned my addr 172.21.15.73:0/3342288306 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443886894 0 0) 0x7fc2f813c870 con 0x7fc2f813f350 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): my global_id is 5008 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2dc003550 con 0x7fc2f813f350 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1176993080 0 0) 0x7fc2f813e780 con 0x7fc2f80a72f0 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): my global_id is 5117 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2f813c870 con 0x7fc2f80a72f0 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940903450 0 0) 0x7fc2f813c590 con 0x7fc2f8138d40 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): my global_id is 5088 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2f813e780 con 0x7fc2f8138d40 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4152737625 0 0) 0x7fc2dc003550 con 0x7fc2f813f350 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2f813c590 con 0x7fc2f813f350 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc2f0001440 con 0x7fc2f813f350 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): dump: 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.370 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2291400457 0 0) 0x7fc2f813c870 con 0x7fc2f80a72f0 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2dc003550 con 0x7fc2f80a72f0 2024-09-11T02:00:49.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc2f4001340 con 0x7fc2f80a72f0 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient(hunting): dump: 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.372 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1625152020 0 0) 0x7fc2f813c590 con 0x7fc2f813f350 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 >> v1:172.21.15.203:6791/0 conn(0x7fc2f80a72f0 legacy=0x7fc2f81399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 >> v1:172.21.15.203:6790/0 conn(0x7fc2f8138d40 legacy=0x7fc2f813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 monclient: found mon.c 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:49.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f813a800 con 0x7fc2f813f350 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 5 monclient: authenticate success, global_id 5008 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient: _renew_subs 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f80a5280 con 0x7fc2f813f350 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient: _renew_subs 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc2f813bfd0 con 0x7fc2f813f350 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc2f0002020 con 0x7fc2f813f350 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2fcbb1640 4 set_mon_vals no callback set 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.349+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc2f0001d50 con 0x7fc2f813f350 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.350+0000 7fc2eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.350+0000 7fc2eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.350+0000 7fc2eeffd640 10 monclient: dump: 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.375 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.350+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fc2f0011a30 con 0x7fc2f813f350 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.350+0000 7fc300618640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.350+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc2e00065c0 con 0x7fc2e0002860 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.350+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 4136420502 0 0) 0x7fc2f004e650 con 0x7fc2f813f350 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2fdbb3640 10 monclient: get_auth_request con 0x7fc2dc040390 auth_method 0 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1641297926 0 0) 0x7fc2e00065c0 con 0x7fc2e0002860 2024-09-11T02:00:49.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 10 monclient(hunting): my global_id is 114135 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2f813c590 con 0x7fc2e0002860 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3929498852 0 0) 0x7fc2f813c590 con 0x7fc2e0002860 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2e00065c0 con 0x7fc2e0002860 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc2f4004b20 con 0x7fc2e0002860 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 10 monclient: dump: 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.377 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 497750746 0 0) 0x7fc2e00065c0 con 0x7fc2e0002860 2024-09-11T02:00:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2e000a160 con 0x7fc2e0002860 2024-09-11T02:00:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc2f4004f20 con 0x7fc2e0002860 2024-09-11T02:00:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 >> v1:172.21.15.73:6792/0 conn(0x7fc2e0002860 legacy=0x7fc2e0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.351+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 >> v1:172.21.15.73:6792/0 conn(0x7fc2e0002860 legacy=0x7fc2e0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.357+0000 7fc300618640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.357+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc2e0009e50 con 0x7fc2e0009110 2024-09-11T02:00:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435905521 0 0) 0x7fc2e0009e50 con 0x7fc2e0009110 2024-09-11T02:00:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 10 monclient(hunting): my global_id is 114144 2024-09-11T02:00:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2e00065c0 con 0x7fc2e0009110 2024-09-11T02:00:49.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2298304976 0 0) 0x7fc2e00065c0 con 0x7fc2e0009110 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2e0009e50 con 0x7fc2e0009110 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc2f4005680 con 0x7fc2e0009110 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 10 monclient: dump: 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.382 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 885812670 0 0) 0x7fc2e0009e50 con 0x7fc2e0009110 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 --> v1:172.21.15.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc2e000c3f0 con 0x7fc2e0009110 2024-09-11T02:00:49.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2004452535) 0x7fc2f4006af0 con 0x7fc2e0009110 2024-09-11T02:00:49.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:49.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:49.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 >> v1:172.21.15.73:6792/0 conn(0x7fc2e0009110 legacy=0x7fc2e00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.358+0000 7fc2eeffd640 1 -- 172.21.15.73:0/3342288306 >> v1:172.21.15.73:6792/0 conn(0x7fc2e0009110 legacy=0x7fc2e00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.384 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:49.384 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:49.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:49.384 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 15946, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.385 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.386 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.387 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.388 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.389 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:49.390 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.391 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:49.392 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:49.393 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.394 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.398 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.399 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.402 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:49.404 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 >> v1:172.21.15.203:6812/2311533528 conn(0x7fc2dc040390 legacy=0x7fc2dc042850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc300618640 10 monclient: shutdown 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc300618640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 >> v1:172.21.15.73:6791/0 conn(0x7fc2f813f350 legacy=0x7fc2f81d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc2febb5640 1 -- 172.21.15.73:0/3342288306 reap_dead start 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc2febb5640 1 -- 172.21.15.73:0/3342288306 reap_dead start 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 shutdown_connections 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 >> 172.21.15.73:0/3342288306 conn(0x7fc2f80a8050 msgr2=0x7fc2f80a9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 shutdown_connections 2024-09-11T02:00:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.359+0000 7fc300618640 1 -- 172.21.15.73:0/3342288306 wait complete. 2024-09-11T02:00:49.407 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:49.407 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-11T02:00:49.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.504+0000 7f9fabc1f640 10 monclient: get_monmap_and_config 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.504+0000 7f9fabc1f640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.504+0000 7f9fabc1f640 10 monclient: monmap: 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:49.505424+0000 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:49.505424+0000 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.506 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.507 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.507 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 1 Processor -- start 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 1 -- start start 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 10 monclient: init 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 10 monclient: _add_conns ranks=[6,5,8,3,7,4,0,2,1] 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 10 monclient(hunting): picked mon.noname-d con 0x7f9fa40a5ba0 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 10 monclient(hunting): picked mon.noname-h con 0x7f9fa409db00 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 10 monclient(hunting): picked mon.noname-e con 0x7f9fa40a6690 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa40a7a50 con 0x7f9fa409db00 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa406fb30 con 0x7f9fa40a5ba0 2024-09-11T02:00:49.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa409ce40 con 0x7f9fa40a6690 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fabc1f640 10 monclient(hunting): authenticate will time out at 891.109840s 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fa99bb640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f9fa40a5ba0 0x7f9fa40a5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:44724/0 (socket says 172.21.15.73:44724) 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.505+0000 7f9fa99bb640 1 -- 172.21.15.73:0/387729542 learned_addr learned my addr 172.21.15.73:0/387729542 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247366802 0 0) 0x7f9fa406fb30 con 0x7f9fa40a5ba0 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient(hunting): my global_id is 114153 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f90003520 con 0x7f9fa40a5ba0 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828520203 0 0) 0x7f9fa409ce40 con 0x7f9fa40a6690 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient(hunting): my global_id is 114146 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fa406fb30 con 0x7f9fa40a6690 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 28153209 0 0) 0x7f9fa406fb30 con 0x7f9fa40a6690 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 >> v1:172.21.15.73:6792/0 conn(0x7f9fa40a5ba0 legacy=0x7f9fa40a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 >> v1:172.21.15.203:6791/0 conn(0x7f9fa409db00 legacy=0x7f9fa413ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 monclient: found mon.noname-e 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa40a7440 con 0x7f9fa40a6690 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fabc1f640 5 monclient: authenticate success, global_id 114146 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9f9c001b90 con 0x7f9fa40a6690 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fabc1f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: dump: 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.519 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fabc1f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f9c001d30 con 0x7f9fa40a6690 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 1 -- 172.21.15.73:0/387729542 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9f9c003cd0 con 0x7f9fa40a6690 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fabc1f640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:49.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fabc1f640 4 set_mon_vals no callback set 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fa89b9640 10 monclient: dump: 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.521 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fabc1f640 10 monclient: shutdown 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fabc1f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.506+0000 7f9fabc1f640 1 -- 172.21.15.73:0/387729542 >> v1:172.21.15.73:6793/0 conn(0x7f9fa40a6690 legacy=0x7f9fa41414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.507+0000 7f9fabc1f640 1 -- 172.21.15.73:0/387729542 shutdown_connections 2024-09-11T02:00:49.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.507+0000 7f9fabc1f640 1 -- 172.21.15.73:0/387729542 >> 172.21.15.73:0/387729542 conn(0x7f9fa40a7e80 msgr2=0x7f9fa40a8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.507+0000 7f9fabc1f640 1 -- 172.21.15.73:0/387729542 shutdown_connections 2024-09-11T02:00:49.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.507+0000 7f9fabc1f640 1 -- 172.21.15.73:0/387729542 wait complete. 2024-09-11T02:00:49.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.507+0000 7f9fabc1f640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.507+0000 7f9fabc1f640 10 monclient: monmap: 2024-09-11T02:00:49.523 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.523 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:49.523 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:49.523 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:49.523 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.507+0000 7f9fabc1f640 1 Processor -- start 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 1 -- start start 2024-09-11T02:00:49.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 10 monclient: init 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 10 monclient: _add_conns ranks=[6,0,7,3,4,5,8,2,1] 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 10 monclient(hunting): picked mon.noname-d con 0x7f9fa409db00 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 10 monclient(hunting): picked mon.noname-a con 0x7f9fa40a5ba0 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 10 monclient(hunting): picked mon.noname-i con 0x7f9fa40a6690 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa4126340 con 0x7f9fa40a5ba0 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa40a85b0 con 0x7f9fa409db00 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa4139300 con 0x7f9fa40a6690 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fabc1f640 10 monclient(hunting): authenticate will time out at 891.112511s 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fa99bb640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f9fa409db00 0x7f9fa4138bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:44726/0 (socket says 172.21.15.73:44726) 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9fa99bb640 1 -- 172.21.15.73:0/1470110355 learned_addr learned my addr 172.21.15.73:0/1470110355 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97537055 0 0) 0x7f9fa40a85b0 con 0x7f9fa409db00 2024-09-11T02:00:49.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 10 monclient(hunting): my global_id is 114162 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f88003520 con 0x7f9fa409db00 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632636984 0 0) 0x7f9fa4126340 con 0x7f9fa40a5ba0 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 10 monclient(hunting): my global_id is 5265 2024-09-11T02:00:49.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fa40a85b0 con 0x7f9fa40a5ba0 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.508+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 803703457 0 0) 0x7f9fa40a85b0 con 0x7f9fa40a5ba0 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9fa4126340 con 0x7f9fa40a5ba0 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1587662171 0 0) 0x7f9f88003520 con 0x7f9fa409db00 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9fa40a85b0 con 0x7f9fa409db00 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9f94001950 con 0x7f9fa40a5ba0 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): dump: 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.527 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9fa0001b90 con 0x7f9fa409db00 2024-09-11T02:00:49.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): dump: 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.529 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2506257399 0 0) 0x7f9fa4139300 con 0x7f9fa40a6690 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient(hunting): my global_id is 5020 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f88003520 con 0x7f9fa40a6690 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 925816647 0 0) 0x7f9fa40a85b0 con 0x7f9fa409db00 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 >> v1:172.21.15.203:6792/0 conn(0x7f9fa40a6690 legacy=0x7f9fa41d57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 >> v1:172.21.15.73:6789/0 conn(0x7f9fa40a5ba0 legacy=0x7f9fa41d20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 monclient: found mon.d 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa4123fe0 con 0x7f9fa409db00 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9fabc1f640 5 monclient: authenticate success, global_id 114162 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9fabc1f640 10 monclient: _renew_subs 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9fabc1f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa4125aa0 con 0x7f9fa409db00 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9fabc1f640 10 monclient: _renew_subs 2024-09-11T02:00:49.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9fabc1f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9fa41c21f0 con 0x7f9fa409db00 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9fa0004a90 con 0x7f9fa409db00 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9fa0004f80 con 0x7f9fa409db00 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9bfff640 4 set_mon_vals no callback set 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.509+0000 7f9f9a7fc640 10 monclient: dump: 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.532 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9fabc1f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9f8c0065c0 con 0x7f9f8c002860 2024-09-11T02:00:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9fa00116c0 con 0x7f9fa409db00 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 4136420502 0 0) 0x7f9fa004e4b0 con 0x7f9fa409db00 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650933789 0 0) 0x7f9f8c0065c0 con 0x7f9f8c002860 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 10 monclient(hunting): my global_id is 114155 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fa40a85b0 con 0x7f9f8c002860 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9faa1bc640 10 monclient: get_auth_request con 0x7f9f88040350 auth_method 0 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3345196095 0 0) 0x7f9fa40a85b0 con 0x7f9f8c002860 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f8c0065c0 con 0x7f9f8c002860 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9f94003c00 con 0x7f9f8c002860 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 10 monclient: dump: 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.535 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.536 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.536 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2805848013 0 0) 0x7f9f8c0065c0 con 0x7f9f8c002860 2024-09-11T02:00:49.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.510+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f8c00a160 con 0x7f9f8c002860 2024-09-11T02:00:49.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.511+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9f940050e0 con 0x7f9f8c002860 2024-09-11T02:00:49.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.511+0000 7f9f9a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.511+0000 7f9f9a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:49.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.511+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 >> v1:172.21.15.73:6793/0 conn(0x7f9f8c002860 legacy=0x7f9f8c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.511+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 >> v1:172.21.15.73:6793/0 conn(0x7f9f8c002860 legacy=0x7f9f8c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9fabc1f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9f8c009e70 con 0x7f9f8c009130 2024-09-11T02:00:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650659440 0 0) 0x7f9f8c009e70 con 0x7f9f8c009130 2024-09-11T02:00:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 10 monclient(hunting): my global_id is 114164 2024-09-11T02:00:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f8c0065c0 con 0x7f9f8c009130 2024-09-11T02:00:49.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4119304655 0 0) 0x7f9f8c0065c0 con 0x7f9f8c009130 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f8c009e70 con 0x7f9f8c009130 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9f94005900 con 0x7f9f8c009130 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 10 monclient: dump: 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.539 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3362013508 0 0) 0x7f9f8c009e70 con 0x7f9f8c009130 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.517+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 --> v1:172.21.15.73:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9f8c00c410 con 0x7f9f8c009130 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 3937511498) 0x7f9f94005be0 con 0x7f9f8c009130 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9f9a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9f9a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:49.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 >> v1:172.21.15.73:6793/0 conn(0x7f9f8c009130 legacy=0x7f9f8c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9f9a7fc640 1 -- 172.21.15.73:0/1470110355 >> v1:172.21.15.73:6793/0 conn(0x7f9f8c009130 legacy=0x7f9f8c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.541 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 16105, 2024-09-11T02:00:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:49.542 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:49.543 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.544 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:49.545 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:49.547 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.548 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.549 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.550 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.551 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.553 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.554 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.556 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:49.557 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.559 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.560 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:49.561 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9f88040350 legacy=0x7f9f88042810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9fabc1f640 10 monclient: shutdown 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9fabc1f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 >> v1:172.21.15.73:6792/0 conn(0x7f9fa409db00 legacy=0x7f9fa4138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9faa1bc640 1 -- 172.21.15.73:0/1470110355 reap_dead start 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9faa1bc640 1 -- 172.21.15.73:0/1470110355 reap_dead start 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 shutdown_connections 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 >> 172.21.15.73:0/1470110355 conn(0x7f9fa40a7e80 msgr2=0x7f9fa41c0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 shutdown_connections 2024-09-11T02:00:49.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.518+0000 7f9fabc1f640 1 -- 172.21.15.73:0/1470110355 wait complete. 2024-09-11T02:00:49.564 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:49.564 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-11T02:00:49.564 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-11T02:00:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.676+0000 7f5cd013d640 10 monclient: get_monmap_and_config 2024-09-11T02:00:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.676+0000 7f5cd013d640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.676+0000 7f5cd013d640 10 monclient: monmap: 2024-09-11T02:00:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:49.677504+0000 2024-09-11T02:00:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:49.677504+0000 2024-09-11T02:00:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.679 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.687 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:49.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36484]: starting. 2024-09-11T02:00:49.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36484]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36449 2024-09-11T02:00:49.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36484]: created object 0... 2024-09-11T02:00:49.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36484]: created object 25... 2024-09-11T02:00:49.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36484]: created object 49... 2024-09-11T02:00:49.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36484]: finishing. 2024-09-11T02:00:49.687 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36484]: shutting down. 2024-09-11T02:00:49.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.677+0000 7f5cd013d640 1 Processor -- start 2024-09-11T02:00:49.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.677+0000 7f5cd013d640 1 -- start start 2024-09-11T02:00:49.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.677+0000 7f5cd013d640 10 monclient: init 2024-09-11T02:00:49.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.677+0000 7f5cd013d640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.677+0000 7f5cd013d640 10 monclient: _add_conns ranks=[3,8,5,7,6,4,0,1,2] 2024-09-11T02:00:49.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.677+0000 7f5cd013d640 10 monclient(hunting): picked mon.noname-g con 0x7f5cc8138960 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:49.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.677+0000 7f5cd013d640 10 monclient(hunting): picked mon.noname-e con 0x7f5cc8139450 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.677+0000 7f5cd013d640 10 monclient(hunting): picked mon.noname-h con 0x7f5cc813f620 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc809d030 con 0x7f5cc8138960 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc809d310 con 0x7f5cc813f620 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc806f770 con 0x7f5cc8139450 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 10 monclient(hunting): authenticate will time out at 891.282090s 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccd6d8640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f5cc8139450 0x7f5cc813df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38536/0 (socket says 172.21.15.73:38536) 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccd6d8640 1 -- 172.21.15.73:0/2340628138 learned_addr learned my addr 172.21.15.73:0/2340628138 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 501877458 0 0) 0x7f5cc806f770 con 0x7f5cc8139450 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): my global_id is 114173 2024-09-11T02:00:49.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cb4003520 con 0x7f5cc8139450 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536846933 0 0) 0x7f5cc809d030 con 0x7f5cc8138960 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): my global_id is 5097 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc806f770 con 0x7f5cc8138960 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812793215 0 0) 0x7f5cc809d310 con 0x7f5cc813f620 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient(hunting): my global_id is 5135 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc809d030 con 0x7f5cc813f620 2024-09-11T02:00:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2214899912 0 0) 0x7f5cb4003520 con 0x7f5cc8139450 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 >> v1:172.21.15.203:6791/0 conn(0x7f5cc813f620 legacy=0x7f5cc8141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 >> v1:172.21.15.203:6790/0 conn(0x7f5cc8138960 legacy=0x7f5cc8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 monclient: found mon.noname-e 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc80a7360 con 0x7f5cc8139450 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 5 monclient: authenticate success, global_id 114173 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5cb8001830 con 0x7f5cc8139450 2024-09-11T02:00:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: dump: 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.693 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5cb8001a50 con 0x7f5cc8139450 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 1 -- 172.21.15.73:0/2340628138 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5cb8004be0 con 0x7f5cc8139450 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5cd013d640 4 set_mon_vals no callback set 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.678+0000 7f5ccced7640 10 monclient: dump: 2024-09-11T02:00:49.694 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.695 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.679+0000 7f5cd013d640 10 monclient: shutdown 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.679+0000 7f5cd013d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.679+0000 7f5cd013d640 1 -- 172.21.15.73:0/2340628138 >> v1:172.21.15.73:6793/0 conn(0x7f5cc8139450 legacy=0x7f5cc813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.679+0000 7f5cd013d640 1 -- 172.21.15.73:0/2340628138 shutdown_connections 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.679+0000 7f5cd013d640 1 -- 172.21.15.73:0/2340628138 >> 172.21.15.73:0/2340628138 conn(0x7f5cc80a8050 msgr2=0x7f5cc80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.679+0000 7f5cd013d640 1 -- 172.21.15.73:0/2340628138 shutdown_connections 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.679+0000 7f5cd013d640 1 -- 172.21.15.73:0/2340628138 wait complete. 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.680+0000 7f5cd013d640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.680+0000 7f5cd013d640 10 monclient: monmap: 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:49.696 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.680+0000 7f5cd013d640 1 Processor -- start 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.680+0000 7f5cd013d640 1 -- start start 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.680+0000 7f5cd013d640 10 monclient: init 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 10 monclient: _add_conns ranks=[0,2,3,6,1,8,5,4,7] 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 10 monclient(hunting): picked mon.noname-a con 0x7f5cc8138960 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 10 monclient(hunting): picked mon.noname-b con 0x7f5cc8139450 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 10 monclient(hunting): picked mon.noname-g con 0x7f5cc813f620 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc813ce20 con 0x7f5cc8138960 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc8142a30 con 0x7f5cc8139450 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc813f050 con 0x7f5cc813f620 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cd013d640 10 monclient(hunting): authenticate will time out at 891.285226s 2024-09-11T02:00:49.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5ccded9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5cc8138960 0x7f5cc81cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51916/0 (socket says 172.21.15.73:51916) 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5ccd6d8640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f5cc8139450 0x7f5cc81d29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:56460/0 (socket says 172.21.15.73:56460) 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5ccded9640 1 -- 172.21.15.73:0/2186505284 learned_addr learned my addr 172.21.15.73:0/2186505284 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010304974 0 0) 0x7f5cc813ce20 con 0x7f5cc8138960 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): my global_id is 5274 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cac003520 con 0x7f5cc8138960 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028103112 0 0) 0x7f5cc8142a30 con 0x7f5cc8139450 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): my global_id is 5132 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc813ce20 con 0x7f5cc8139450 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479022402 0 0) 0x7f5cc813f050 con 0x7f5cc813f620 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): my global_id is 5106 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc8142a30 con 0x7f5cc813f620 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2029897782 0 0) 0x7f5cac003520 con 0x7f5cc8138960 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cc813f050 con 0x7f5cc8138960 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5cc4001bd0 con 0x7f5cc8138960 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:00:49.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): dump: 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.701 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2396596302 0 0) 0x7f5cc813ce20 con 0x7f5cc8139450 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cac003520 con 0x7f5cc8139450 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 171860349 0 0) 0x7f5cc8142a30 con 0x7f5cc813f620 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cc813ce20 con 0x7f5cc813f620 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5cb8004b20 con 0x7f5cc8139450 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.681+0000 7f5cbe7fc640 10 monclient(hunting): dump: 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.703 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5cc0001b50 con 0x7f5cc813f620 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient(hunting): dump: 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.704 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3446936674 0 0) 0x7f5cc813f050 con 0x7f5cc8138960 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 >> v1:172.21.15.203:6790/0 conn(0x7f5cc813f620 legacy=0x7f5cc81d60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 >> v1:172.21.15.73:6790/0 conn(0x7f5cc8139450 legacy=0x7f5cc81d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 1 monclient: found mon.a 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:00:49.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc813cb40 con 0x7f5cc8138960 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cd013d640 5 monclient: authenticate success, global_id 5274 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cd013d640 10 monclient: _renew_subs 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cd013d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc813ed50 con 0x7f5cc8138960 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cd013d640 10 monclient: _renew_subs 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cd013d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5cc81ce2b0 con 0x7f5cc8138960 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5cc40038c0 con 0x7f5cc8138960 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5cc4003db0 con 0x7f5cc8138960 2024-09-11T02:00:49.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbffff640 4 set_mon_vals no callback set 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cbe7fc640 10 monclient: dump: 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.707 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.682+0000 7f5cd013d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5cb00065c0 con 0x7f5cb0002860 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f5cc4003fd0 con 0x7f5cc8138960 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 529299112 0 0) 0x7f5cc404e610 con 0x7f5cc8138960 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102466049 0 0) 0x7f5cb00065c0 con 0x7f5cb0002860 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 10 monclient(hunting): my global_id is 4978 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cc813f050 con 0x7f5cb0002860 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cce6da640 10 monclient: get_auth_request con 0x7f5cac0406b0 auth_method 0 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 94039999 0 0) 0x7f5cc813f050 con 0x7f5cb0002860 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cb00065c0 con 0x7f5cb0002860 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5cb8004ea0 con 0x7f5cb0002860 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.683+0000 7f5cbe7fc640 10 monclient: dump: 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.709 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.684+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1078261031 0 0) 0x7f5cb00065c0 con 0x7f5cb0002860 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.684+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cb000a160 con 0x7f5cb0002860 2024-09-11T02:00:49.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.684+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5cb8007480 con 0x7f5cb0002860 2024-09-11T02:00:49.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.684+0000 7f5cbe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.684+0000 7f5cbe7fc640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:49.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.684+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 >> v1:172.21.15.203:6789/0 conn(0x7f5cb0002860 legacy=0x7f5cb0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.684+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 >> v1:172.21.15.203:6789/0 conn(0x7f5cb0002860 legacy=0x7f5cb0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.711 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:49.712 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36486]: starting. 2024-09-11T02:00:49.712 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36486]: listing objects. 2024-09-11T02:00:49.712 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36486]: listed object 0... 2024-09-11T02:00:49.712 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36486]: listed object 25... 2024-09-11T02:00:49.712 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36486]: saw 50 objects 2024-09-11T02:00:49.712 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36486]: shutting down. 2024-09-11T02:00:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cd013d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5cb0009e70 con 0x7f5cb0009130 2024-09-11T02:00:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422256485 0 0) 0x7f5cb0009e70 con 0x7f5cb0009130 2024-09-11T02:00:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 10 monclient(hunting): my global_id is 4987 2024-09-11T02:00:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cb00065c0 con 0x7f5cb0009130 2024-09-11T02:00:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1019922185 0 0) 0x7f5cb00065c0 con 0x7f5cb0009130 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5cb0009e70 con 0x7f5cb0009130 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5cb80055f0 con 0x7f5cb0009130 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 10 monclient: dump: 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3295124886 0 0) 0x7f5cb0009e70 con 0x7f5cb0009130 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.691+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 --> v1:172.21.15.203:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5cb000c410 con 0x7f5cb0009130 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3692709141) 0x7f5cb8006b20 con 0x7f5cb0009130 2024-09-11T02:00:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cbe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:49.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cbe7fc640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:49.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 >> v1:172.21.15.203:6789/0 conn(0x7f5cb0009130 legacy=0x7f5cb00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cbe7fc640 1 -- 172.21.15.73:0/2186505284 >> v1:172.21.15.203:6789/0 conn(0x7f5cb0009130 legacy=0x7f5cb00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.717 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:49.717 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:49.717 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:49.717 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:49.717 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 172107, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:00:49.718 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.719 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.720 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:49.721 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.722 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.724 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.725 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.726 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.727 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:49.728 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.729 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.730 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.731 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.733 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.734 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:49.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.736 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:49.736 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:49.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 >> v1:172.21.15.203:6812/2311533528 conn(0x7f5cac0406b0 legacy=0x7f5cac042b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cd013d640 10 monclient: shutdown 2024-09-11T02:00:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cd013d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 >> v1:172.21.15.73:6789/0 conn(0x7f5cc8138960 legacy=0x7f5cc81cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cce6da640 1 -- 172.21.15.73:0/2186505284 reap_dead start 2024-09-11T02:00:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cce6da640 1 -- 172.21.15.73:0/2186505284 reap_dead start 2024-09-11T02:00:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 shutdown_connections 2024-09-11T02:00:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 >> 172.21.15.73:0/2186505284 conn(0x7f5cc80a8050 msgr2=0x7f5cc8141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 shutdown_connections 2024-09-11T02:00:49.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.692+0000 7f5cd013d640 1 -- 172.21.15.73:0/2186505284 wait complete. 2024-09-11T02:00:49.738 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:49.739 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-11T02:00:49.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-11T02:00:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.836+0000 7fa32aee6640 10 monclient: get_monmap_and_config 2024-09-11T02:00:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.836+0000 7fa32aee6640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.836+0000 7fa32aee6640 10 monclient: monmap: 2024-09-11T02:00:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:49.837343+0000 2024-09-11T02:00:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:49.837343+0000 2024-09-11T02:00:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.838 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.839 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 1 Processor -- start 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 1 -- start start 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 10 monclient: init 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 10 monclient: _add_conns ranks=[4,6,7,5,3,1,2,0,8] 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 10 monclient(hunting): picked mon.noname-c con 0x7fa324138d40 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 10 monclient(hunting): picked mon.noname-d con 0x7fa3240a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 10 monclient(hunting): picked mon.noname-i con 0x7fa32413f350 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32409ca00 con 0x7fa324138d40 2024-09-11T02:00:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3240a7070 con 0x7fa3240a72f0 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32409cee0 con 0x7fa32413f350 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa32aee6640 10 monclient(hunting): authenticate will time out at 891.441766s 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa328c82640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fa324138d40 0x7fa324139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49458/0 (socket says 172.21.15.73:49458) 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa323fff640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fa3240a72f0 0x7fa32413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:44740/0 (socket says 172.21.15.73:44740) 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.837+0000 7fa328c82640 1 -- 172.21.15.73:0/2440966077 learned_addr learned my addr 172.21.15.73:0/2440966077 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108979937 0 0) 0x7fa32409ca00 con 0x7fa324138d40 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient(hunting): my global_id is 5017 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa310003520 con 0x7fa324138d40 2024-09-11T02:00:49.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504522465 0 0) 0x7fa3240a7070 con 0x7fa3240a72f0 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient(hunting): my global_id is 114171 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa32409ca00 con 0x7fa3240a72f0 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3742372630 0 0) 0x7fa310003520 con 0x7fa324138d40 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 >> v1:172.21.15.203:6792/0 conn(0x7fa32413f350 legacy=0x7fa324141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 >> v1:172.21.15.73:6792/0 conn(0x7fa3240a72f0 legacy=0x7fa32413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 monclient: found mon.noname-c 2024-09-11T02:00:49.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32409d1c0 con 0x7fa324138d40 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa32aee6640 5 monclient: authenticate success, global_id 5017 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa31c001850 con 0x7fa324138d40 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa32aee6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: dump: 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.851 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.852 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa32aee6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa31c0019f0 con 0x7fa324138d40 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 1 -- 172.21.15.73:0/2440966077 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa31c004be0 con 0x7fa324138d40 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa32aee6640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa32aee6640 4 set_mon_vals no callback set 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa3237fe640 10 monclient: dump: 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.853 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa32aee6640 10 monclient: shutdown 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa32aee6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.838+0000 7fa32aee6640 1 -- 172.21.15.73:0/2440966077 >> v1:172.21.15.73:6791/0 conn(0x7fa324138d40 legacy=0x7fa324139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.839+0000 7fa32aee6640 1 -- 172.21.15.73:0/2440966077 shutdown_connections 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.839+0000 7fa32aee6640 1 -- 172.21.15.73:0/2440966077 >> 172.21.15.73:0/2440966077 conn(0x7fa3240a8050 msgr2=0x7fa3240a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.839+0000 7fa32aee6640 1 -- 172.21.15.73:0/2440966077 shutdown_connections 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.839+0000 7fa32aee6640 1 -- 172.21.15.73:0/2440966077 wait complete. 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.839+0000 7fa32aee6640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.839+0000 7fa32aee6640 10 monclient: monmap: 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.855 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.839+0000 7fa32aee6640 1 Processor -- start 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.839+0000 7fa32aee6640 1 -- start start 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.839+0000 7fa32aee6640 10 monclient: init 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:49.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 10 monclient: _add_conns ranks=[4,5,2,3,1,6,7,0,8] 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 10 monclient(hunting): picked mon.noname-c con 0x7fa3240a72f0 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 10 monclient(hunting): picked mon.noname-h con 0x7fa324138d40 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 10 monclient(hunting): picked mon.noname-b con 0x7fa32413f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32413c500 con 0x7fa32413f350 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32413c7e0 con 0x7fa3240a72f0 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32413cac0 con 0x7fa324138d40 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa32aee6640 10 monclient(hunting): authenticate will time out at 891.444555s 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa328c82640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fa3240a72f0 0x7fa32413e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49462/0 (socket says 172.21.15.73:49462) 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa328c82640 1 -- 172.21.15.73:0/3366224959 learned_addr learned my addr 172.21.15.73:0/3366224959 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705589320 0 0) 0x7fa32413c7e0 con 0x7fa3240a72f0 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): my global_id is 5026 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa304003520 con 0x7fa3240a72f0 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427285257 0 0) 0x7fa32413c500 con 0x7fa32413f350 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): my global_id is 5141 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa32413c7e0 con 0x7fa32413f350 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421114056 0 0) 0x7fa32413cac0 con 0x7fa324138d40 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.840+0000 7fa3217fa640 10 monclient(hunting): my global_id is 5144 2024-09-11T02:00:49.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa32413c500 con 0x7fa324138d40 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 745759780 0 0) 0x7fa304003520 con 0x7fa3240a72f0 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa32413cac0 con 0x7fa3240a72f0 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa31c004c00 con 0x7fa3240a72f0 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient(hunting): dump: 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.859 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3378198532 0 0) 0x7fa32413c7e0 con 0x7fa32413f350 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa304003520 con 0x7fa32413f350 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa30c001930 con 0x7fa32413f350 2024-09-11T02:00:49.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient(hunting): dump: 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.861 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 37479830 0 0) 0x7fa32413cac0 con 0x7fa3240a72f0 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 >> v1:172.21.15.203:6791/0 conn(0x7fa324138d40 legacy=0x7fa3241d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 >> v1:172.21.15.73:6790/0 conn(0x7fa32413f350 legacy=0x7fa3241d54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient: _finish_hunting 0 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 monclient: found mon.c 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32413cda0 con 0x7fa3240a72f0 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient: _finish_auth 0 2024-09-11T02:00:49.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient: _check_auth_tickets 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa32aee6640 5 monclient: authenticate success, global_id 5026 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa32aee6640 10 monclient: _renew_subs 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa32aee6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa32413b870 con 0x7fa3240a72f0 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa32aee6640 10 monclient: _renew_subs 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa32aee6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3241d6da0 con 0x7fa3240a72f0 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa31c001190 con 0x7fa3240a72f0 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa31c0019c0 con 0x7fa3240a72f0 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa322ffd640 4 set_mon_vals no callback set 2024-09-11T02:00:49.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.841+0000 7fa3217fa640 10 monclient: dump: 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.864 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa32aee6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa3080065c0 con 0x7fa308002860 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fa31c011440 con 0x7fa3240a72f0 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 529299112 0 0) 0x7fa31c04e360 con 0x7fa3240a72f0 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009033754 0 0) 0x7fa3080065c0 con 0x7fa308002860 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 10 monclient(hunting): my global_id is 5115 2024-09-11T02:00:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa32413cac0 con 0x7fa308002860 2024-09-11T02:00:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa329483640 10 monclient: get_auth_request con 0x7fa304040240 auth_method 0 2024-09-11T02:00:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3016928841 0 0) 0x7fa32413cac0 con 0x7fa308002860 2024-09-11T02:00:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3080065c0 con 0x7fa308002860 2024-09-11T02:00:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa314004f20 con 0x7fa308002860 2024-09-11T02:00:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 10 monclient: dump: 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.867 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1971041397 0 0) 0x7fa3080065c0 con 0x7fa308002860 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.842+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.203:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa30800a160 con 0x7fa308002860 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.843+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa314007260 con 0x7fa308002860 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.843+0000 7fa3217fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.843+0000 7fa3217fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.843+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 >> v1:172.21.15.203:6790/0 conn(0x7fa308002860 legacy=0x7fa308004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.843+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 >> v1:172.21.15.203:6790/0 conn(0x7fa308002860 legacy=0x7fa308004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.849+0000 7fa32aee6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.849+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa308009e50 con 0x7fa308009110 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.849+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 672825183 0 0) 0x7fa308009e50 con 0x7fa308009110 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.849+0000 7fa3217fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.849+0000 7fa3217fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.849+0000 7fa3217fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.849+0000 7fa3217fa640 10 monclient(hunting): my global_id is 5124 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.849+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3080065c0 con 0x7fa308009110 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.849+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2283341930 0 0) 0x7fa3080065c0 con 0x7fa308009110 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa308009e50 con 0x7fa308009110 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3140058b0 con 0x7fa308009110 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:49.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 10 monclient: dump: 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:49.871 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2663699427 0 0) 0x7fa308009e50 con 0x7fa308009110 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 --> v1:172.21.15.203:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa30800c3f0 con 0x7fa308009110 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 3574766281) 0x7fa314006de0 con 0x7fa308009110 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 >> v1:172.21.15.203:6790/0 conn(0x7fa308009110 legacy=0x7fa3080095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa3217fa640 1 -- 172.21.15.73:0/3366224959 >> v1:172.21.15.203:6790/0 conn(0x7fa308009110 legacy=0x7fa3080095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:49.872 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 172288, 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:49.873 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.874 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.875 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.876 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:49.877 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:49.878 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.879 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.881 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:49.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.883 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.885 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.887 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.888 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:49.889 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:49.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:49.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:49.892 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:49.892 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:49.892 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-09-11T02:00:49.892 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:49.892 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:49.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:49.892 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:49.892 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 >> v1:172.21.15.203:6812/2311533528 conn(0x7fa304040240 legacy=0x7fa304042700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa32aee6640 10 monclient: shutdown 2024-09-11T02:00:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa32aee6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 >> v1:172.21.15.73:6791/0 conn(0x7fa3240a72f0 legacy=0x7fa32413e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa329483640 1 -- 172.21.15.73:0/3366224959 reap_dead start 2024-09-11T02:00:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa329483640 1 -- 172.21.15.73:0/3366224959 reap_dead start 2024-09-11T02:00:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 shutdown_connections 2024-09-11T02:00:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.850+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 >> 172.21.15.73:0/3366224959 conn(0x7fa3240a8050 msgr2=0x7fa3240a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.851+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 shutdown_connections 2024-09-11T02:00:49.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.851+0000 7fa32aee6640 1 -- 172.21.15.73:0/3366224959 wait complete. 2024-09-11T02:00:49.894 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:49.894 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-11T02:00:49.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-11T02:00:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.991+0000 7f5d97247640 10 monclient: get_monmap_and_config 2024-09-11T02:00:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.991+0000 7f5d97247640 10 monclient: build_initial_monmap 2024-09-11T02:00:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.991+0000 7f5d97247640 10 monclient: monmap: 2024-09-11T02:00:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:49.992498+0000 2024-09-11T02:00:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:49.992498+0000 2024-09-11T02:00:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:49.993 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:49.994 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 1 Processor -- start 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 1 -- start start 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 10 monclient: init 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 10 monclient: _add_conns ranks=[8,3,0,4,5,6,2,1,7] 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 10 monclient(hunting): picked mon.noname-e con 0x7f5d90138d40 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 10 monclient(hunting): picked mon.noname-g con 0x7f5d900a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 10 monclient(hunting): picked mon.noname-a con 0x7f5d9013f350 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9009ca00 con 0x7f5d9013f350 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d900a7070 con 0x7f5d900a72f0 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9009cee0 con 0x7f5d90138d40 2024-09-11T02:00:50.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:50.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.992+0000 7f5d97247640 10 monclient(hunting): authenticate will time out at 891.596987s 2024-09-11T02:00:50.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d957e4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5d9013f350 0x7f5d90141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51922/0 (socket says 172.21.15.73:51922) 2024-09-11T02:00:50.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d94fe3640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f5d90138d40 0x7f5d90139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38544/0 (socket says 172.21.15.73:38544) 2024-09-11T02:00:50.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d957e4640 1 -- 172.21.15.73:0/3099164636 learned_addr learned my addr 172.21.15.73:0/3099164636 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:50.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261304361 0 0) 0x7f5d9009cee0 con 0x7f5d90138d40 2024-09-11T02:00:50.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): my global_id is 114182 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d78003520 con 0x7f5d90138d40 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131398507 0 0) 0x7f5d9009ca00 con 0x7f5d9013f350 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): my global_id is 5283 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d9009cee0 con 0x7f5d9013f350 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256483734 0 0) 0x7f5d900a7070 con 0x7f5d900a72f0 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient(hunting): my global_id is 5133 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d9009ca00 con 0x7f5d900a72f0 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1485056931 0 0) 0x7f5d78003520 con 0x7f5d90138d40 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 >> v1:172.21.15.203:6790/0 conn(0x7f5d900a72f0 legacy=0x7f5d9013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 >> v1:172.21.15.73:6789/0 conn(0x7f5d9013f350 legacy=0x7f5d90141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 monclient: found mon.noname-e 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9009d1c0 con 0x7f5d90138d40 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: _finish_auth 0 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5d800017b0 con 0x7f5d90138d40 2024-09-11T02:00:50.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d97247640 5 monclient: authenticate success, global_id 114182 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d97247640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: dump: 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.007 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d97247640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d80001950 con 0x7f5d90138d40 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d97247640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 1 -- 172.21.15.73:0/3099164636 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5d80004b20 con 0x7f5d90138d40 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d97247640 4 set_mon_vals no callback set 2024-09-11T02:00:50.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.993+0000 7f5d8f7fe640 10 monclient: dump: 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.009 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.994+0000 7f5d97247640 10 monclient: shutdown 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.994+0000 7f5d97247640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.994+0000 7f5d97247640 1 -- 172.21.15.73:0/3099164636 >> v1:172.21.15.73:6793/0 conn(0x7f5d90138d40 legacy=0x7f5d90139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.994+0000 7f5d97247640 1 -- 172.21.15.73:0/3099164636 shutdown_connections 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.994+0000 7f5d97247640 1 -- 172.21.15.73:0/3099164636 >> 172.21.15.73:0/3099164636 conn(0x7f5d900a8050 msgr2=0x7f5d900a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.994+0000 7f5d97247640 1 -- 172.21.15.73:0/3099164636 shutdown_connections 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.994+0000 7f5d97247640 1 -- 172.21.15.73:0/3099164636 wait complete. 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.994+0000 7f5d97247640 10 monclient: build_initial_monmap 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.994+0000 7f5d97247640 10 monclient: monmap: 2024-09-11T02:00:50.010 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:50.011 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 1 Processor -- start 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 1 -- start start 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 10 monclient: init 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 10 monclient: _add_conns ranks=[8,7,6,4,0,5,3,1,2] 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 10 monclient(hunting): picked mon.noname-e con 0x7f5d900a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 10 monclient(hunting): picked mon.noname-i con 0x7f5d90138d40 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 10 monclient(hunting): picked mon.noname-d con 0x7f5d9013f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d901424f0 con 0x7f5d9013f350 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d9009fa60 con 0x7f5d90138d40 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d901427d0 con 0x7f5d900a72f0 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:50.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d97247640 10 monclient(hunting): authenticate will time out at 891.599925s 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d94fe3640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f5d900a72f0 0x7f5d9009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38554/0 (socket says 172.21.15.73:38554) 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.995+0000 7f5d94fe3640 1 -- 172.21.15.73:0/2740494201 learned_addr learned my addr 172.21.15.73:0/2740494201 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731581921 0 0) 0x7f5d901427d0 con 0x7f5d900a72f0 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): my global_id is 114191 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d7c003520 con 0x7f5d900a72f0 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374001114 0 0) 0x7f5d901424f0 con 0x7f5d9013f350 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): my global_id is 114180 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d901427d0 con 0x7f5d9013f350 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734969918 0 0) 0x7f5d9009fa60 con 0x7f5d90138d40 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): my global_id is 5038 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d901424f0 con 0x7f5d90138d40 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2488566494 0 0) 0x7f5d7c003520 con 0x7f5d900a72f0 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d9009fa60 con 0x7f5d900a72f0 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5d800013b0 con 0x7f5d900a72f0 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): dump: 2024-09-11T02:00:50.014 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.015 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2417761715 0 0) 0x7f5d901427d0 con 0x7f5d9013f350 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d7c003520 con 0x7f5d9013f350 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5d88001870 con 0x7f5d9013f350 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): dump: 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.016 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 977900310 0 0) 0x7f5d901424f0 con 0x7f5d90138d40 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d901427d0 con 0x7f5d90138d40 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5d84001d50 con 0x7f5d90138d40 2024-09-11T02:00:50.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient(hunting): dump: 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2780685195 0 0) 0x7f5d9009fa60 con 0x7f5d900a72f0 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 >> v1:172.21.15.203:6792/0 conn(0x7f5d90138d40 legacy=0x7f5d9009f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 >> v1:172.21.15.73:6792/0 conn(0x7f5d9013f350 legacy=0x7f5d901d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient: _finish_hunting 0 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 monclient: found mon.e 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d900a5280 con 0x7f5d900a72f0 2024-09-11T02:00:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient: _finish_auth 0 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient: _check_auth_tickets 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d97247640 5 monclient: authenticate success, global_id 114191 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d97247640 10 monclient: _renew_subs 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d97247640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5d900a1430 con 0x7f5d900a72f0 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d97247640 10 monclient: _renew_subs 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d80004de0 con 0x7f5d900a72f0 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d97247640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f5d900a04d0 con 0x7f5d900a72f0 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5d800052d0 con 0x7f5d900a72f0 2024-09-11T02:00:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8d7fa640 10 monclient: dump: 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.996+0000 7f5d8effd640 4 set_mon_vals no callback set 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d97247640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d900008d0 con 0x7f5d90138500 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f5d80011a10 con 0x7f5d900a72f0 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 529299112 0 0) 0x7f5d8004e390 con 0x7f5d900a72f0 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811536458 0 0) 0x7f5d900008d0 con 0x7f5d90138500 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d8d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d8d7fa640 10 monclient(hunting): my global_id is 5153 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d9009fa60 con 0x7f5d90138500 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.997+0000 7f5d957e4640 10 monclient: get_auth_request con 0x7f5d7c040600 auth_method 0 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2687827274 0 0) 0x7f5d9009fa60 con 0x7f5d90138500 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d900008d0 con 0x7f5d90138500 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5d84003d30 con 0x7f5d90138500 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 10 monclient: dump: 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.023 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2871868736 0 0) 0x7f5d900008d0 con 0x7f5d90138500 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d9002e450 con 0x7f5d90138500 2024-09-11T02:00:50.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5d84006050 con 0x7f5d90138500 2024-09-11T02:00:50.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:50.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:50.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 >> v1:172.21.15.203:6791/0 conn(0x7f5d90138500 legacy=0x7f5d900a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:49.998+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 >> v1:172.21.15.203:6791/0 conn(0x7f5d90138500 legacy=0x7f5d900a2da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.004+0000 7f5d97247640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.004+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d900a3bc0 con 0x7f5d9002e600 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933712822 0 0) 0x7f5d900a3bc0 con 0x7f5d9002e600 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 10 monclient(hunting): my global_id is 5162 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d900008d0 con 0x7f5d9002e600 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 687462740 0 0) 0x7f5d900008d0 con 0x7f5d9002e600 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d900a3bc0 con 0x7f5d9002e600 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5d84004750 con 0x7f5d9002e600 2024-09-11T02:00:50.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 10 monclient: dump: 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.028 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4206324813 0 0) 0x7f5d900a3bc0 con 0x7f5d9002e600 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 --> v1:172.21.15.203:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d901dec10 con 0x7f5d9002e600 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 4266915368) 0x7f5d84005bc0 con 0x7f5d9002e600 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 >> v1:172.21.15.203:6791/0 conn(0x7f5d9002e600 legacy=0x7f5d900a34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.005+0000 7f5d8d7fa640 1 -- 172.21.15.73:0/2740494201 >> v1:172.21.15.203:6791/0 conn(0x7f5d9002e600 legacy=0x7f5d900a34b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 172442, 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.039 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.040 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:50.042 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:50.045 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.046 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:50.047 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.048 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:50.050 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:50.051 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 >> v1:172.21.15.203:6812/2311533528 conn(0x7f5d7c040600 legacy=0x7f5d7c042ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d97247640 10 monclient: shutdown 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d97247640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 >> v1:172.21.15.73:6793/0 conn(0x7f5d900a72f0 legacy=0x7f5d9009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d957e4640 1 -- 172.21.15.73:0/2740494201 reap_dead start 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d957e4640 1 -- 172.21.15.73:0/2740494201 reap_dead start 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 shutdown_connections 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 >> 172.21.15.73:0/2740494201 conn(0x7f5d900a8050 msgr2=0x7f5d9013ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 shutdown_connections 2024-09-11T02:00:50.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.006+0000 7f5d97247640 1 -- 172.21.15.73:0/2740494201 wait complete. 2024-09-11T02:00:50.054 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:50.054 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-11T02:00:50.054 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-11T02:00:50.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.150+0000 7f477536b640 10 monclient: get_monmap_and_config 2024-09-11T02:00:50.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.150+0000 7f477536b640 10 monclient: build_initial_monmap 2024-09-11T02:00:50.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.150+0000 7f477536b640 10 monclient: monmap: 2024-09-11T02:00:50.152 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:50.152 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.152 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:50.151387+0000 2024-09-11T02:00:50.152 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:50.151387+0000 2024-09-11T02:00:50.152 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:50.152 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:50.153 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 1 Processor -- start 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 1 -- start start 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 10 monclient: init 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 10 monclient: _add_conns ranks=[4,6,3,7,2,1,8,5,0] 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 10 monclient(hunting): picked mon.noname-c con 0x7f4770138960 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 10 monclient(hunting): picked mon.noname-d con 0x7f4770139450 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 10 monclient(hunting): picked mon.noname-g con 0x7f477013f620 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477009d030 con 0x7f477013f620 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477009d310 con 0x7f4770138960 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477006f770 con 0x7f4770139450 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:50.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f477536b640 10 monclient(hunting): authenticate will time out at 891.755777s 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f476e7fc640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f4770139450 0x7f477013df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:44748/0 (socket says 172.21.15.73:44748) 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f476effd640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f4770138960 0x7f4770138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49478/0 (socket says 172.21.15.73:49478) 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.151+0000 7f476e7fc640 1 -- 172.21.15.73:0/3975299477 learned_addr learned my addr 172.21.15.73:0/3975299477 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003496717 0 0) 0x7f477009d310 con 0x7f4770138960 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient(hunting): my global_id is 5035 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4758003520 con 0x7f4770138960 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213037737 0 0) 0x7f477006f770 con 0x7f4770139450 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient(hunting): my global_id is 114189 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f477009d310 con 0x7f4770139450 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1323832846 0 0) 0x7f4758003520 con 0x7f4770138960 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 >> v1:172.21.15.73:6792/0 conn(0x7f4770139450 legacy=0x7f477013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 >> v1:172.21.15.203:6790/0 conn(0x7f477013f620 legacy=0x7f4770141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: _finish_hunting 0 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 monclient: found mon.noname-c 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47700a7360 con 0x7f4770138960 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: _finish_auth 0 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: _check_auth_tickets 2024-09-11T02:00:50.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4760001830 con 0x7f4770138960 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 5 monclient: authenticate success, global_id 5035 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: dump: 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.165 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4760001a50 con 0x7f4770138960 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 1 -- 172.21.15.73:0/3975299477 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4760004b20 con 0x7f4770138960 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:50.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 4 set_mon_vals no callback set 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f476dffb640 10 monclient: dump: 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.167 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.168 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.168 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 10 monclient: shutdown 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 1 -- 172.21.15.73:0/3975299477 >> v1:172.21.15.73:6791/0 conn(0x7f4770138960 legacy=0x7f4770138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 1 -- 172.21.15.73:0/3975299477 shutdown_connections 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.152+0000 7f477536b640 1 -- 172.21.15.73:0/3975299477 >> 172.21.15.73:0/3975299477 conn(0x7f47700a8050 msgr2=0x7f47700a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.153+0000 7f477536b640 1 -- 172.21.15.73:0/3975299477 shutdown_connections 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.153+0000 7f477536b640 1 -- 172.21.15.73:0/3975299477 wait complete. 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.153+0000 7f477536b640 10 monclient: build_initial_monmap 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.153+0000 7f477536b640 10 monclient: monmap: 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:50.169 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 1 Processor -- start 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 1 -- start start 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 10 monclient: init 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 10 monclient: _add_conns ranks=[1,2,4,3,6,8,7,5,0] 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 10 monclient(hunting): picked mon.noname-f con 0x7f4770138960 addr v1:172.21.15.203:6789/0 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 10 monclient(hunting): picked mon.noname-b con 0x7f4770139450 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 10 monclient(hunting): picked mon.noname-c con 0x7f477013f620 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477013ace0 con 0x7f4770138960 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477013eec0 con 0x7f4770139450 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47700a1c60 con 0x7f477013f620 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f477536b640 10 monclient(hunting): authenticate will time out at 891.758532s 2024-09-11T02:00:50.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f476e7fc640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f4770139450 0x7f47701d25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:56474/0 (socket says 172.21.15.73:56474) 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f476f7fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f477013f620 0x7f47701d5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:49482/0 (socket says 172.21.15.73:49482) 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f476e7fc640 1 -- 172.21.15.73:0/1827712228 learned_addr learned my addr 172.21.15.73:0/1827712228 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1116025584 0 0) 0x7f47700a1c60 con 0x7f477013f620 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): my global_id is 5044 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f475c003520 con 0x7f477013f620 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167089303 0 0) 0x7f477013eec0 con 0x7f4770139450 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): my global_id is 5150 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47700a1c60 con 0x7f4770139450 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054878999 0 0) 0x7f477013ace0 con 0x7f4770138960 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 10 monclient(hunting): my global_id is 4996 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.154+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f477013eec0 con 0x7f4770138960 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2362835387 0 0) 0x7f475c003520 con 0x7f477013f620 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f477013ace0 con 0x7f477013f620 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4768001d90 con 0x7f477013f620 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:50.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient(hunting): dump: 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.174 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2522500372 0 0) 0x7f47700a1c60 con 0x7f4770139450 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f475c003520 con 0x7f4770139450 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4764001ad0 con 0x7f4770139450 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient(hunting): dump: 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.175 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2378759566 0 0) 0x7f477013ace0 con 0x7f477013f620 2024-09-11T02:00:50.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 >> v1:172.21.15.73:6790/0 conn(0x7f4770139450 legacy=0x7f47701d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 >> v1:172.21.15.203:6789/0 conn(0x7f4770138960 legacy=0x7f4770137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient: _finish_hunting 0 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 monclient: found mon.c 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477013c130 con 0x7f477013f620 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient: _finish_auth 0 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient: _check_auth_tickets 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f477536b640 5 monclient: authenticate success, global_id 5044 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f477536b640 10 monclient: _renew_subs 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f477536b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:50.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47700a1420 con 0x7f477013f620 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f477536b640 10 monclient: _renew_subs 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f477536b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f477013b3b0 con 0x7f477013f620 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4768002090 con 0x7f477013f620 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4768003f80 con 0x7f477013f620 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f476d7fa640 4 set_mon_vals no callback set 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.155+0000 7f47577fe640 10 monclient: dump: 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.178 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f477536b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f47500065c0 con 0x7f4750002860 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f4768004120 con 0x7f477013f620 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 529299112 0 0) 0x7f476804e520 con 0x7f477013f620 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069500285 0 0) 0x7f47500065c0 con 0x7f4750002860 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 10 monclient(hunting): my global_id is 5047 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f477013ace0 con 0x7f4750002860 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f476e7fc640 10 monclient: get_auth_request con 0x7f475c040160 auth_method 0 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 907379414 0 0) 0x7f477013ace0 con 0x7f4750002860 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47500065c0 con 0x7f4750002860 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4760004de0 con 0x7f4750002860 2024-09-11T02:00:50.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 10 monclient: dump: 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.181 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 462761672 0 0) 0x7f47500065c0 con 0x7f4750002860 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.156+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.203:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f475000a160 con 0x7f4750002860 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.157+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4760007480 con 0x7f4750002860 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.157+0000 7f47577fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.157+0000 7f47577fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.157+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 >> v1:172.21.15.203:6792/0 conn(0x7f4750002860 legacy=0x7f4750004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.157+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 >> v1:172.21.15.203:6792/0 conn(0x7f4750002860 legacy=0x7f4750004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:50.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.163+0000 7f477536b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:50.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.163+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4750009e70 con 0x7f4750009130 2024-09-11T02:00:50.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.163+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096652672 0 0) 0x7f4750009e70 con 0x7f4750009130 2024-09-11T02:00:50.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.163+0000 7f47577fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.163+0000 7f47577fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.163+0000 7f47577fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.163+0000 7f47577fe640 10 monclient(hunting): my global_id is 5056 2024-09-11T02:00:50.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.163+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47500065c0 con 0x7f4750009130 2024-09-11T02:00:50.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1674055481 0 0) 0x7f47500065c0 con 0x7f4750009130 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4750009e70 con 0x7f4750009130 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4760005700 con 0x7f4750009130 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 10 monclient: dump: 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.185 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1824000783 0 0) 0x7f4750009e70 con 0x7f4750009130 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 --> v1:172.21.15.203:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f475000c410 con 0x7f4750009130 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3932001571) 0x7f4760006c30 con 0x7f4750009130 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:50.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 >> v1:172.21.15.203:6792/0 conn(0x7f4750009130 legacy=0x7f47500095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.164+0000 7f47577fe640 1 -- 172.21.15.73:0/1827712228 >> v1:172.21.15.203:6792/0 conn(0x7f4750009130 legacy=0x7f47500095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 172585, 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:50.187 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:50.188 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:50.189 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:50.191 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:50.192 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.193 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.194 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:50.195 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.196 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:50.197 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.199 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.200 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.201 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:50.202 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.203 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.204 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:50.205 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:50.206 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 >> v1:172.21.15.203:6812/2311533528 conn(0x7f475c040160 legacy=0x7f475c042620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f477536b640 10 monclient: shutdown 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f477536b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 >> v1:172.21.15.73:6791/0 conn(0x7f477013f620 legacy=0x7f47701d5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f476f7fe640 1 -- 172.21.15.73:0/1827712228 reap_dead start 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f476f7fe640 1 -- 172.21.15.73:0/1827712228 reap_dead start 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 shutdown_connections 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 >> 172.21.15.73:0/1827712228 conn(0x7f47700a8050 msgr2=0x7f4770141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 shutdown_connections 2024-09-11T02:00:50.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.165+0000 7f477536b640 1 -- 172.21.15.73:0/1827712228 wait complete. 2024-09-11T02:00:50.209 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:50.209 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T02:00:50.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.305+0000 7fb362e7f640 10 monclient: get_monmap_and_config 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.305+0000 7fb362e7f640 10 monclient: build_initial_monmap 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.305+0000 7fb362e7f640 10 monclient: monmap: 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:50.305897+0000 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:50.305897+0000 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.307 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.305+0000 7fb362e7f640 1 Processor -- start 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.305+0000 7fb362e7f640 1 -- start start 2024-09-11T02:00:50.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.305+0000 7fb362e7f640 10 monclient: init 2024-09-11T02:00:50.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:50.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 10 monclient: _add_conns ranks=[8,4,3,5,7,6,1,2,0] 2024-09-11T02:00:50.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 10 monclient(hunting): picked mon.noname-e con 0x7fb35c138960 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:50.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 10 monclient(hunting): picked mon.noname-c con 0x7fb35c139450 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:50.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 10 monclient(hunting): picked mon.noname-g con 0x7fb35c13f620 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:50.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb35c09d030 con 0x7fb35c13f620 2024-09-11T02:00:50.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb35c09d310 con 0x7fb35c139450 2024-09-11T02:00:50.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb35c06f770 con 0x7fb35c138960 2024-09-11T02:00:50.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:50.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 10 monclient(hunting): authenticate will time out at 891.910397s 2024-09-11T02:00:50.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb360c1b640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fb35c138960 0x7fb35c138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:38562/0 (socket says 172.21.15.73:38562) 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb360c1b640 1 -- 172.21.15.73:0/642841917 learned_addr learned my addr 172.21.15.73:0/642841917 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941917237 0 0) 0x7fb35c06f770 con 0x7fb35c138960 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): my global_id is 114200 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34c003520 con 0x7fb35c138960 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208122515 0 0) 0x7fb35c09d310 con 0x7fb35c139450 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): my global_id is 5053 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb35c06f770 con 0x7fb35c139450 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791660311 0 0) 0x7fb35c09d030 con 0x7fb35c13f620 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient(hunting): my global_id is 5151 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb35c09d310 con 0x7fb35c13f620 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3534958809 0 0) 0x7fb35c06f770 con 0x7fb35c139450 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 >> v1:172.21.15.73:6793/0 conn(0x7fb35c138960 legacy=0x7fb35c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 >> v1:172.21.15.203:6790/0 conn(0x7fb35c13f620 legacy=0x7fb35c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 monclient: found mon.noname-c 2024-09-11T02:00:50.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:50.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:00:50.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c0a7360 con 0x7fb35c139450 2024-09-11T02:00:50.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient: _finish_auth 0 2024-09-11T02:00:50.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:00:50.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:50.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb348001810 con 0x7fb35c139450 2024-09-11T02:00:50.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 5 monclient: authenticate success, global_id 5053 2024-09-11T02:00:50.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:50.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb35b7fe640 10 monclient: dump: 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.323 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.306+0000 7fb362e7f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3480019b0 con 0x7fb35c139450 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb35b7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb362e7f640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb35b7fe640 1 -- 172.21.15.73:0/642841917 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb348003950 con 0x7fb35c139450 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb362e7f640 4 set_mon_vals no callback set 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb35b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:50.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb35b7fe640 10 monclient: dump: 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.325 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb362e7f640 10 monclient: shutdown 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb362e7f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb362e7f640 1 -- 172.21.15.73:0/642841917 >> v1:172.21.15.73:6791/0 conn(0x7fb35c139450 legacy=0x7fb35c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb362e7f640 1 -- 172.21.15.73:0/642841917 shutdown_connections 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb362e7f640 1 -- 172.21.15.73:0/642841917 >> 172.21.15.73:0/642841917 conn(0x7fb35c0a8050 msgr2=0x7fb35c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb362e7f640 1 -- 172.21.15.73:0/642841917 shutdown_connections 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.307+0000 7fb362e7f640 1 -- 172.21.15.73:0/642841917 wait complete. 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.308+0000 7fb362e7f640 10 monclient: build_initial_monmap 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.308+0000 7fb362e7f640 10 monclient: monmap: 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:50.326 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:50.327 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.308+0000 7fb362e7f640 1 Processor -- start 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.308+0000 7fb362e7f640 1 -- start start 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.308+0000 7fb362e7f640 10 monclient: init 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 10 monclient: _add_conns ranks=[5,6,7,1,0,8,4,2,3] 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 10 monclient(hunting): picked mon.noname-h con 0x7fb35c138960 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 10 monclient(hunting): picked mon.noname-d con 0x7fb35c139450 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 10 monclient(hunting): picked mon.noname-i con 0x7fb35c13f620 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb35c13e8c0 con 0x7fb35c138960 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb35c13aaf0 con 0x7fb35c139450 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb35c13c660 con 0x7fb35c13f620 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:50.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb362e7f640 10 monclient(hunting): authenticate will time out at 891.913192s 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb35bfff640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fb35c139450 0x7fb35c13a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:44750/0 (socket says 172.21.15.73:44750) 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb35bfff640 1 -- 172.21.15.73:0/3180805491 learned_addr learned my addr 172.21.15.73:0/3180805491 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820029853 0 0) 0x7fb35c13aaf0 con 0x7fb35c139450 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): my global_id is 114198 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb340003520 con 0x7fb35c139450 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799204628 0 0) 0x7fb35c13c660 con 0x7fb35c13f620 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): my global_id is 5065 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb35c13aaf0 con 0x7fb35c13f620 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726948039 0 0) 0x7fb35c13e8c0 con 0x7fb35c138960 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): my global_id is 5171 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb35c13c660 con 0x7fb35c138960 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4104925862 0 0) 0x7fb340003520 con 0x7fb35c139450 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb35c13e8c0 con 0x7fb35c139450 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb348003930 con 0x7fb35c139450 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): dump: 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3140940822 0 0) 0x7fb35c13aaf0 con 0x7fb35c13f620 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb340003520 con 0x7fb35c13f620 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb354001cf0 con 0x7fb35c13f620 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient(hunting): dump: 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.332 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2002740616 0 0) 0x7fb35c13c660 con 0x7fb35c138960 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb35c13aaf0 con 0x7fb35c138960 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1412848501 0 0) 0x7fb35c13e8c0 con 0x7fb35c139450 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 >> v1:172.21.15.203:6792/0 conn(0x7fb35c13f620 legacy=0x7fb35c1d5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 >> v1:172.21.15.203:6791/0 conn(0x7fb35c138960 legacy=0x7fb35c139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.309+0000 7fb3597fa640 10 monclient: _finish_hunting 0 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 1 monclient: found mon.d 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c13b140 con 0x7fb35c139450 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 10 monclient: _finish_auth 0 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 10 monclient: _check_auth_tickets 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 5 monclient: authenticate success, global_id 114198 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 10 monclient: _renew_subs 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb35c13ee30 con 0x7fb35c139450 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 10 monclient: _renew_subs 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb35c0a48b0 con 0x7fb35c139450 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb348003c10 con 0x7fb35c139450 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb348004180 con 0x7fb35c139450 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb35affd640 4 set_mon_vals no callback set 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 10 monclient: dump: 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fb3480043a0 con 0x7fb35c139450 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.310+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33c005080 con 0x7fb35c139450 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.311+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 529299112 0 0) 0x7fb34804e500 con 0x7fb35c139450 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.311+0000 7fb360c1b640 10 monclient: get_auth_request con 0x7fb3400404c0 auth_method 0 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.315+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fb35c0a48b0 con 0x7fb35c139450 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.315+0000 7fb3597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.315+0000 7fb3597fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:50.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.561+0000 7fb362e7f640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-11T02:00:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.561+0000 7fb362e7f640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-11T02:00:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.561+0000 7fb362e7f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.561+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb33c005c40 con 0x7fb35c139450 2024-09-11T02:00:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.562+0000 7fb3597fa640 1 -- 172.21.15.73:0/3180805491 <== mon.6 v1:172.21.15.73:6792/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fb3480177e0 con 0x7fb35c139450 2024-09-11T02:00:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.562+0000 7fb3597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-11T02:00:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.562+0000 7fb3597fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:50.568 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.562+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.568 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.562+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=3609911482,config=2586702516,health=3958713506,kv=691542103,logm=1868705364}) 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.562+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=10,kv=12,logm=59} crc {auth=1269153016,config=2586702516,health=498930614,kv=691542103,logm=1969067389}) 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=3609911482,config=2586702516,health=3958713506,kv=691542103,logm=1868705364}) 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=12,kv=12,logm=57} crc {auth=2609598573,config=2586702516,health=3958713506,kv=691542104,logm=1167351408}) 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=3609911482,config=2586702516,health=3958713506,kv=691542103,logm=1868705364}) 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=596207024,config=2586702516,health=519153983,kv=691542103,logm=4108032803}) 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=3609911482,config=2586702516,health=3958713506,kv=691542103,logm=1868705364}) 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=18,config=2,health=11,kv=12,logm=57} crc {auth=812627951,config=2586702516,health=4214863631,kv=691542103,logm=2293286299}) 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.569 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=3609911482,config=2586702516,health=3958713506,kv=691542103,logm=1868705364}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=2,health=11,kv=11,logm=58} crc {auth=305007419,config=2586702516,health=907334632,kv=2619118242,logm=377204089}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=3609911482,config=2586702516,health=3958713506,kv=691542103,logm=1868705364}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=596207024,config=2586702516,health=907334632,kv=691542103,logm=3058223735}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=3609911482,config=2586702516,health=3958713506,kv=691542103,logm=1868705364}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=16,config=2,health=12,kv=11,logm=59} crc {auth=2796914924,config=575665002,health=3958713506,kv=4265998402,logm=332611917}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=3609911482,config=2586702516,health=3958713506,kv=691542103,logm=1868705364}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.563+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=2655340632,config=2586702516,health=917538330,kv=691542104,logm=1121443656}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=389645906}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=101270615}) 2024-09-11T02:00:50.570 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=389645906}) 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3473693434}) 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=389645906}) 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3022451261}) 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=389645906}) 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2289141534}) 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=389645906}) 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2126271113}) 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.571 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=389645906}) 2024-09-11T02:00:50.572 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3540846063}) 2024-09-11T02:00:50.572 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.572 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=389645906}) 2024-09-11T02:00:50.572 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3573144776}) 2024-09-11T02:00:50.572 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.572 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=389645906}) 2024-09-11T02:00:50.572 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.564+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3516991203}) 2024-09-11T02:00:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.565+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 >> v1:172.21.15.203:6812/2311533528 conn(0x7fb3400404c0 legacy=0x7fb340042980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.565+0000 7fb362e7f640 10 monclient: shutdown 2024-09-11T02:00:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.565+0000 7fb362e7f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.565+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 >> v1:172.21.15.73:6792/0 conn(0x7fb35c139450 legacy=0x7fb35c13a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.565+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 shutdown_connections 2024-09-11T02:00:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.565+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 >> 172.21.15.73:0/3180805491 conn(0x7fb35c0a8050 msgr2=0x7fb35c0a8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.565+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 shutdown_connections 2024-09-11T02:00:50.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:50.565+0000 7fb362e7f640 1 -- 172.21.15.73:0/3180805491 wait complete. 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341833936}) 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=45557317}) 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341833936}) 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2801490357}) 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341833936}) 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4259408337}) 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.585 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341833936}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=950785285}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341833936}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=559826045}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341833936}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3019448738}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341833936}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2601731957}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1341833936}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.566+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2472372121}) 2024-09-11T02:00:50.586 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295630367}) 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1073632110}) 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295630367}) 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1995498056}) 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295630367}) 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2866760910}) 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295630367}) 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2188379738}) 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295630367}) 2024-09-11T02:00:50.587 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3637152391}) 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295630367}) 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1492014366}) 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295630367}) 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=842634212}) 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295630367}) 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.567+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2384498859}) 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681538627}) 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1286957767}) 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.588 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681538627}) 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2194342114}) 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681538627}) 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=769718987}) 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681538627}) 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2726702094}) 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681538627}) 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=541648805}) 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.589 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681538627}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2533198467}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681538627}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3214849369}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681538627}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.568+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2509637725}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484849380}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1364088080}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484849380}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3172156487}) 2024-09-11T02:00:50.590 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484849380}) 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4179115161}) 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484849380}) 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2125829011}) 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484849380}) 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2281007130}) 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484849380}) 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3188839054}) 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.569+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484849380}) 2024-09-11T02:00:50.591 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.570+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=678696144}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.570+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.570+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484849380}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.570+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2698159781}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=919776322}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=615325865}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=919776322}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1291742919}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=919776322}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3631065265}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=919776322}) 2024-09-11T02:00:50.592 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=994255947}) 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=919776322}) 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2455582126}) 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=919776322}) 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1857188137}) 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=919776322}) 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=9554601}) 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=919776322}) 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.571+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=477972657}) 2024-09-11T02:00:50.593 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=851690127,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=83,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=5} crc {logm=1283395915,mdsmap=3149052893,mgr=2248164467,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=1155879501}) 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=851690127,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=3820192381,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=851690127,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=85,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=3} crc {logm=90677858,mdsmap=3149052893,mgr=1367969684,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3629258893}) 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=851690127,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=555741474,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.594 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=851690127,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=84,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=2872279406,mdsmap=3149052893,mgr=1101835460,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=851690127,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=5} crc {logm=365120361,mdsmap=3149052893,mgr=25274659,mgr_metadata=1396927942,mgrstat=1155879501}) 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=851690127,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=82,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=5} crc {logm=3971464319,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=1155879501}) 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=851690127,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2811248099}) 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.572+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=84,mdsmap=3,mgr=6,mgr_metadata=1,mgrstat=6} crc {logm=78670683,mdsmap=3149052893,mgr=1876304612,mgr_metadata=1396927942,mgrstat=1216554524}) 2024-09-11T02:00:50.595 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=7,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=1954740197,mon_config_key=2601195904,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1024293314}) 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=1,osdmap=64} crc {mgrstat=3081227816,mon_config_key=4091866,monmap=2295470326,nvmeofgw=3140514009,osd_metadata=1276872287,osd_pg_creating=3266497506,osd_snap=3823785925,osdmap=2601517781}) 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=7,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=1954740197,mon_config_key=2601195904,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1024293314}) 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=60} crc {mgrstat=3081227816,mon_config_key=916267669,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=2920293182}) 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=7,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=1954740197,mon_config_key=2601195904,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1024293314}) 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mgrstat=8,mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=64} crc {mgrstat=3081227816,mon_config_key=987149515,monmap=2295470326,nvmeofgw=598337686,osd_metadata=920682300,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1384199068}) 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.596 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=7,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=1954740197,mon_config_key=2601195904,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1024293314}) 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=60} crc {mgrstat=3081227816,mon_config_key=1719844690,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=2064990060}) 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=7,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=1954740197,mon_config_key=2601195904,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1024293314}) 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {mgrstat=8,mon_config_key=17,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=61} crc {mgrstat=3081227816,mon_config_key=214447987,monmap=2141158592,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=893146095}) 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=7,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=1954740197,mon_config_key=2601195904,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1024293314}) 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=3081227816,mon_config_key=3095894795,monmap=2295470326,nvmeofgw=598337686,osd_metadata=925954136,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=2586454921}) 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=7,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=1954740197,mon_config_key=2601195904,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1024293314}) 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=61} crc {mgrstat=3081227816,mon_config_key=386759339,monmap=2295470326,nvmeofgw=1596038039,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1352306118}) 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=7,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=1954740197,mon_config_key=2601195904,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=1024293314}) 2024-09-11T02:00:50.597 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.574+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {mgrstat=7,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=62} crc {mgrstat=3161842117,mon_config_key=386759338,monmap=2295470326,nvmeofgw=2613832008,osd_metadata=4243518218,osd_pg_creating=3266497506,osd_snap=4133920409,osdmap=2449650844}) 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1940104374}) 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2104425072}) 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1940104374}) 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3145031934}) 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1940104374}) 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=144361903}) 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1940104374}) 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=445172604}) 2024-09-11T02:00:50.598 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1940104374}) 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=4093818024}) 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1940104374}) 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3030449898}) 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1940104374}) 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3466624129}) 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1940104374}) 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.575+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=74036486}) 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=21} crc {osdmap=4038726787}) 2024-09-11T02:00:50.599 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=22} crc {osdmap=345956179}) 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=21} crc {osdmap=4038726787}) 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=22} crc {osdmap=4046369266}) 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=21} crc {osdmap=4038726787}) 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=22} crc {osdmap=2327683613}) 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=21} crc {osdmap=4038726787}) 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=22} crc {osdmap=2042562527}) 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=21} crc {osdmap=4038726787}) 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=22} crc {osdmap=588898176}) 2024-09-11T02:00:50.600 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.601 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=21} crc {osdmap=4038726787}) 2024-09-11T02:00:50.601 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=21} crc {osdmap=2035665599}) 2024-09-11T02:00:50.601 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.601 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=21} crc {osdmap=4038726787}) 2024-09-11T02:00:50.601 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=23} crc {osdmap=2219999319}) 2024-09-11T02:00:50.601 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:00:50.601 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=21} crc {osdmap=4038726787}) 2024-09-11T02:00:50.601 INFO:tasks.ceph.mon.b.smithi073.stderr:2024-09-11T02:00:50.576+0000 7f8231e75640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=23} crc {osdmap=578235219}) 2024-09-11T02:00:50.602 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-11T02:00:50.603 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:50.603 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36485]: starting. 2024-09-11T02:00:50.603 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36485]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36449 2024-09-11T02:00:50.603 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36485]: shutting down. 2024-09-11T02:00:50.603 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:50.604 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:00:50.604 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:00:50.606 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:00:51.604 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-11T02:00:51.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:00:51.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.711+0000 7f61412ed640 10 monclient: get_monmap_and_config 2024-09-11T02:00:51.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.711+0000 7f61412ed640 10 monclient: build_initial_monmap 2024-09-11T02:00:51.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.711+0000 7f61412ed640 10 monclient: monmap: 2024-09-11T02:00:51.713 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:51.713 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:51.713 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:51.712641+0000 2024-09-11T02:00:51.713 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:51.712641+0000 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:51.714 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:51.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.712+0000 7f61412ed640 1 Processor -- start 2024-09-11T02:00:51.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.712+0000 7f61412ed640 1 -- start start 2024-09-11T02:00:51.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.712+0000 7f61412ed640 10 monclient: init 2024-09-11T02:00:51.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.712+0000 7f61412ed640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:51.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.712+0000 7f61412ed640 10 monclient: _add_conns ranks=[0,2,5,8,1,6,7,4,3] 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.712+0000 7f61412ed640 10 monclient(hunting): picked mon.noname-a con 0x7f613c138960 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.712+0000 7f61412ed640 10 monclient(hunting): picked mon.noname-b con 0x7f613c139450 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.712+0000 7f61412ed640 10 monclient(hunting): picked mon.noname-h con 0x7f613c13f620 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f61412ed640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c09d030 con 0x7f613c138960 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f61412ed640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c09d310 con 0x7f613c139450 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f61412ed640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c06f770 con 0x7f613c13f620 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f61412ed640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f61412ed640 10 monclient(hunting): authenticate will time out at 893.317057s 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613affd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f613c138960 0x7f613c138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47074/0 (socket says 172.21.15.73:47074) 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613affd640 1 -- 172.21.15.73:0/686181364 learned_addr learned my addr 172.21.15.73:0/686181364 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667599509 0 0) 0x7f613c09d310 con 0x7f613c139450 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:51.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient(hunting): my global_id is 5168 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6128003520 con 0x7f613c139450 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619291858 0 0) 0x7f613c09d030 con 0x7f613c138960 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient(hunting): my global_id is 5301 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c09d310 con 0x7f613c138960 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2599596633 0 0) 0x7f6128003520 con 0x7f613c139450 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 >> v1:172.21.15.203:6791/0 conn(0x7f613c13f620 legacy=0x7f613c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 >> v1:172.21.15.73:6789/0 conn(0x7f613c138960 legacy=0x7f613c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:51.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 monclient: found mon.noname-b 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c0a7360 con 0x7f613c139450 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: _finish_auth 0 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6124001830 con 0x7f613c139450 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: dump: 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:51.725 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:51.726 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f61412ed640 5 monclient: authenticate success, global_id 5168 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f61412ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6124001a50 con 0x7f613c139450 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 1 -- 172.21.15.73:0/686181364 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6124001d40 con 0x7f613c139450 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f61412ed640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f61412ed640 4 set_mon_vals no callback set 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:51.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.713+0000 7f613a7fc640 10 monclient: dump: 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:51.728 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.714+0000 7f61412ed640 10 monclient: shutdown 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.714+0000 7f61412ed640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.714+0000 7f61412ed640 1 -- 172.21.15.73:0/686181364 >> v1:172.21.15.73:6790/0 conn(0x7f613c139450 legacy=0x7f613c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.714+0000 7f61412ed640 1 -- 172.21.15.73:0/686181364 shutdown_connections 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.714+0000 7f61412ed640 1 -- 172.21.15.73:0/686181364 >> 172.21.15.73:0/686181364 conn(0x7f613c0a8050 msgr2=0x7f613c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.714+0000 7f61412ed640 1 -- 172.21.15.73:0/686181364 shutdown_connections 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.714+0000 7f61412ed640 1 -- 172.21.15.73:0/686181364 wait complete. 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.714+0000 7f61412ed640 10 monclient: build_initial_monmap 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.714+0000 7f61412ed640 10 monclient: monmap: 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:51.729 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:51.730 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 1 Processor -- start 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 1 -- start start 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 10 monclient: init 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 10 monclient: _add_conns ranks=[8,5,0,2,7,6,4,1,3] 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 10 monclient(hunting): picked mon.noname-e con 0x7f613c138960 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 10 monclient(hunting): picked mon.noname-h con 0x7f613c139450 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 10 monclient(hunting): picked mon.noname-a con 0x7f613c13f620 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c0a5050 con 0x7f613c13f620 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c13c920 con 0x7f613c139450 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c13aaf0 con 0x7f613c138960 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:51.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.715+0000 7f61412ed640 10 monclient(hunting): authenticate will time out at 893.319944s 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f613affd640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f613c138960 0x7f613c139cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53576/0 (socket says 172.21.15.73:53576) 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f613affd640 1 -- 172.21.15.73:0/3975895815 learned_addr learned my addr 172.21.15.73:0/3975895815 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2334525038 0 0) 0x7f613c13aaf0 con 0x7f613c138960 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): my global_id is 114227 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f611c003520 con 0x7f613c138960 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776322845 0 0) 0x7f613c06f770 con 0x7f613c13f620 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:51.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): my global_id is 5310 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c13aaf0 con 0x7f613c13f620 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095487884 0 0) 0x7f613c13c920 con 0x7f613c139450 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): my global_id is 5207 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c06f770 con 0x7f613c139450 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2874298512 0 0) 0x7f611c003520 con 0x7f613c138960 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f613c13c920 con 0x7f613c138960 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f612c001bb0 con 0x7f613c138960 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:51.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): dump: 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:51.734 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2285674200 0 0) 0x7f613c13aaf0 con 0x7f613c13f620 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f611c003520 con 0x7f613c13f620 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6134001cb0 con 0x7f613c13f620 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient(hunting): dump: 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.735 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1282318912 0 0) 0x7f613c13c920 con 0x7f613c138960 2024-09-11T02:00:51.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 >> v1:172.21.15.203:6791/0 conn(0x7f613c139450 legacy=0x7f613c13a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 >> v1:172.21.15.73:6789/0 conn(0x7f613c13f620 legacy=0x7f613c1d5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient: _finish_hunting 0 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 monclient: found mon.e 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c13f2d0 con 0x7f613c138960 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient: _finish_auth 0 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient: _check_auth_tickets 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f61412ed640 5 monclient: authenticate success, global_id 114227 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f61412ed640 10 monclient: _renew_subs 2024-09-11T02:00:51.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f61412ed640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f613c13c640 con 0x7f613c138960 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f61412ed640 10 monclient: _renew_subs 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f61412ed640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f613c13b120 con 0x7f613c138960 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f612c004a90 con 0x7f613c138960 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f612c004f80 con 0x7f613c138960 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6133fff640 10 monclient: dump: 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:51.738 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.716+0000 7f6139ffb640 4 set_mon_vals no callback set 2024-09-11T02:00:51.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.717+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f612c0116c0 con 0x7f613c138960 2024-09-11T02:00:51.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.717+0000 7f61412ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:51.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.717+0000 7f61412ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:51.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.717+0000 7f61412ed640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:51.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.717+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f613c13c410 con 0x7f613c138960 2024-09-11T02:00:51.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.717+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(119..119 src has 1..119) ==== 3898+0+0 (unknown 3361825829 0 0) 0x7f612c04e310 con 0x7f613c138960 2024-09-11T02:00:51.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.717+0000 7f61327fc640 10 monclient: get_auth_request con 0x7f611c040450 auth_method 0 2024-09-11T02:00:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.722+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f612c017670 con 0x7f613c138960 2024-09-11T02:00:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.722+0000 7f6133fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:51.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.722+0000 7f6133fff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:51.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.963+0000 7f61412ed640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:00:51.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.963+0000 7f61412ed640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:00:51.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.963+0000 7f61412ed640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:51.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.963+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f613c074820 con 0x7f613c138960 2024-09-11T02:00:51.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.964+0000 7f6133fff640 1 -- 172.21.15.73:0/3975895815 <== mon.8 v1:172.21.15.73:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 1203853453) 0x7f612c016f70 con 0x7f613c138960 2024-09-11T02:00:51.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.964+0000 7f6133fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:00:51.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.964+0000 7f6133fff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:51.966 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":32,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"b","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:00:51.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.966+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 >> v1:172.21.15.203:6812/2311533528 conn(0x7f611c040450 legacy=0x7f611c042910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:51.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.966+0000 7f61412ed640 10 monclient: shutdown 2024-09-11T02:00:51.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.966+0000 7f61412ed640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:51.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.966+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 >> v1:172.21.15.73:6793/0 conn(0x7f613c138960 legacy=0x7f613c139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:51.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.966+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 shutdown_connections 2024-09-11T02:00:51.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.966+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 >> 172.21.15.73:0/3975895815 conn(0x7f613c0a8050 msgr2=0x7f613c0a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:51.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.966+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 shutdown_connections 2024-09-11T02:00:51.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:51.966+0000 7f61412ed640 1 -- 172.21.15.73:0/3975895815 wait complete. 2024-09-11T02:00:51.978 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-11T02:00:51.978 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T02:00:51.978 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-11T02:00:51.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T02:00:52.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.074+0000 7f13df0e2640 10 monclient: get_monmap_and_config 2024-09-11T02:00:52.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.074+0000 7f13df0e2640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.074+0000 7f13df0e2640 10 monclient: monmap: 2024-09-11T02:00:52.076 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:52.075762+0000 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:52.075762+0000 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.077 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.080 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.080 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.080 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.075+0000 7f13df0e2640 1 Processor -- start 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.075+0000 7f13df0e2640 1 -- start start 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.075+0000 7f13df0e2640 10 monclient: init 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 10 monclient: _add_conns ranks=[6,1,4,7,8,5,3,0,2] 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 10 monclient(hunting): picked mon.noname-d con 0x7f13d8138d40 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 10 monclient(hunting): picked mon.noname-f con 0x7f13d80a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 10 monclient(hunting): picked mon.noname-c con 0x7f13d813f350 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d809ca00 con 0x7f13d80a72f0 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d80a7070 con 0x7f13d813f350 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d809cee0 con 0x7f13d8138d40 2024-09-11T02:00:52.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 10 monclient(hunting): authenticate will time out at 893.680261s 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13dce7e640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f13d8138d40 0x7f13d8139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:41004/0 (socket says 172.21.15.73:41004) 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13dd67f640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f13d813f350 0x7f13d8141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40334/0 (socket says 172.21.15.73:40334) 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13dce7e640 1 -- 172.21.15.73:0/1154034432 learned_addr learned my addr 172.21.15.73:0/1154034432 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333553981 0 0) 0x7f13d809cee0 con 0x7f13d8138d40 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient(hunting): my global_id is 114225 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c0003520 con 0x7f13d8138d40 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727825505 0 0) 0x7f13d80a7070 con 0x7f13d813f350 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient(hunting): my global_id is 5062 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d809cee0 con 0x7f13d813f350 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 903602036 0 0) 0x7f13d809cee0 con 0x7f13d813f350 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 >> v1:172.21.15.73:6792/0 conn(0x7f13d8138d40 legacy=0x7f13d8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 >> v1:172.21.15.203:6789/0 conn(0x7f13d80a72f0 legacy=0x7f13d813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 monclient: found mon.noname-c 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d809d1c0 con 0x7f13d813f350 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f13d0001b10 con 0x7f13d813f350 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13d77fe640 10 monclient: dump: 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.094 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.095 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 5 monclient: authenticate success, global_id 5062 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.076+0000 7f13df0e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13d0001cb0 con 0x7f13d813f350 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13d77fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13d77fe640 1 -- 172.21.15.73:0/1154034432 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f13d0004b60 con 0x7f13d813f350 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13df0e2640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13df0e2640 4 set_mon_vals no callback set 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13d77fe640 10 monclient: dump: 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.096 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13df0e2640 10 monclient: shutdown 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13df0e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13df0e2640 1 -- 172.21.15.73:0/1154034432 >> v1:172.21.15.73:6791/0 conn(0x7f13d813f350 legacy=0x7f13d8141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13df0e2640 1 -- 172.21.15.73:0/1154034432 shutdown_connections 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13df0e2640 1 -- 172.21.15.73:0/1154034432 >> 172.21.15.73:0/1154034432 conn(0x7f13d80a8050 msgr2=0x7f13d80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13df0e2640 1 -- 172.21.15.73:0/1154034432 shutdown_connections 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.077+0000 7f13df0e2640 1 -- 172.21.15.73:0/1154034432 wait complete. 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.078+0000 7f13df0e2640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.078+0000 7f13df0e2640 10 monclient: monmap: 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:52.098 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.099 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.078+0000 7f13df0e2640 1 Processor -- start 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.078+0000 7f13df0e2640 1 -- start start 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.078+0000 7f13df0e2640 10 monclient: init 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 10 monclient: _add_conns ranks=[1,5,3,8,6,7,2,0,4] 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 10 monclient(hunting): picked mon.noname-f con 0x7f13d80a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 10 monclient(hunting): picked mon.noname-h con 0x7f13d8138d40 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 10 monclient(hunting): picked mon.noname-g con 0x7f13d813f350 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d80a1980 con 0x7f13d80a72f0 2024-09-11T02:00:52.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d809fa60 con 0x7f13d813f350 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d80a0de0 con 0x7f13d8138d40 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13df0e2640 10 monclient(hunting): authenticate will time out at 893.683139s 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13dd67f640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7f13d813f350 0x7f13d81d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.73:47028/0 (socket says 172.21.15.73:47028) 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13dd67f640 1 -- 172.21.15.73:0/128670451 learned_addr learned my addr 172.21.15.73:0/128670451 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004759483 0 0) 0x7f13d80a0de0 con 0x7f13d8138d40 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): my global_id is 5216 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c4003550 con 0x7f13d8138d40 2024-09-11T02:00:52.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373860557 0 0) 0x7f13d809fa60 con 0x7f13d813f350 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): my global_id is 5178 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d80a0de0 con 0x7f13d813f350 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657364594 0 0) 0x7f13d80a1980 con 0x7f13d80a72f0 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): my global_id is 5032 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d809fa60 con 0x7f13d80a72f0 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 191123086 0 0) 0x7f13c4003550 con 0x7f13d8138d40 2024-09-11T02:00:52.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13d80a1980 con 0x7f13d8138d40 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f13cc001ad0 con 0x7f13d8138d40 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): dump: 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.103 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1487246251 0 0) 0x7f13d80a0de0 con 0x7f13d813f350 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13c4003550 con 0x7f13d813f350 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f13d00019d0 con 0x7f13d813f350 2024-09-11T02:00:52.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): dump: 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.105 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.106 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2283400628 0 0) 0x7f13d809fa60 con 0x7f13d80a72f0 2024-09-11T02:00:52.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13d80a0de0 con 0x7f13d80a72f0 2024-09-11T02:00:52.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f13c8001590 con 0x7f13d80a72f0 2024-09-11T02:00:52.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T02:00:52.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.079+0000 7f13d57fa640 10 monclient(hunting): dump: 2024-09-11T02:00:52.107 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.107 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3406439387 0 0) 0x7f13d80a1980 con 0x7f13d8138d40 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 >> v1:172.21.15.203:6790/0 conn(0x7f13d813f350 legacy=0x7f13d81d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 >> v1:172.21.15.203:6789/0 conn(0x7f13d80a72f0 legacy=0x7f13d809ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 1 monclient: found mon.h 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d80a52a0 con 0x7f13d8138d40 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13df0e2640 5 monclient: authenticate success, global_id 5216 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13df0e2640 10 monclient: _renew_subs 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13df0e2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.203:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13d8142100 con 0x7f13d8138d40 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13df0e2640 10 monclient: _renew_subs 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13df0e2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.203:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f13d813e420 con 0x7f13d8138d40 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.5 v1:172.21.15.203:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13cc0038a0 con 0x7f13d8138d40 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.5 v1:172.21.15.203:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f13cc003e50 con 0x7f13d8138d40 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d6ffd640 4 set_mon_vals no callback set 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:52.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13d57fa640 10 monclient: dump: 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.111 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13df0e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.080+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f13b80065c0 con 0x7f13b8002860 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1110259351 0 0) 0x7f13b80065c0 con 0x7f13b8002860 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 10 monclient(hunting): my global_id is 5319 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d80a1980 con 0x7f13b8002860 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.5 v1:172.21.15.203:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f13cc004070 con 0x7f13d8138d40 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.5 v1:172.21.15.203:6791/0 8 ==== osd_map(119..119 src has 1..119) ==== 3898+0+0 (unknown 3361825829 0 0) 0x7f13cc04d340 con 0x7f13d8138d40 2024-09-11T02:00:52.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3346826557 0 0) 0x7f13d80a1980 con 0x7f13b8002860 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13b80065c0 con 0x7f13b8002860 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f13c8000f60 con 0x7f13b8002860 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 10 monclient: dump: 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.113 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13dd67f640 10 monclient: get_auth_request con 0x7f13c40406f0 auth_method 0 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 241631031 0 0) 0x7f13b80065c0 con 0x7f13b8002860 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.081+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13b800a160 con 0x7f13b8002860 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.082+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f13c8004ca0 con 0x7f13b8002860 2024-09-11T02:00:52.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.082+0000 7f13d57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.082+0000 7f13d57fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.082+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 >> v1:172.21.15.73:6789/0 conn(0x7f13b8002860 legacy=0x7f13b8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.082+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 >> v1:172.21.15.73:6789/0 conn(0x7f13b8002860 legacy=0x7f13b8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13df0e2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f13b8009e50 con 0x7f13b8009110 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143172272 0 0) 0x7f13b8009e50 con 0x7f13b8009110 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 10 monclient(hunting): my global_id is 5328 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13b80065c0 con 0x7f13b8009110 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2455455927 0 0) 0x7f13b80065c0 con 0x7f13b8009110 2024-09-11T02:00:52.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13b8009e50 con 0x7f13b8009110 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f13c8005510 con 0x7f13b8009110 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 10 monclient: dump: 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.116 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2426023141 0 0) 0x7f13b8009e50 con 0x7f13b8009110 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 --> v1:172.21.15.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f13b800c3a0 con 0x7f13b8009110 2024-09-11T02:00:52.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 3600751885) 0x7f13c8006a20 con 0x7f13b8009110 2024-09-11T02:00:52.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:52.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:52.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 >> v1:172.21.15.73:6789/0 conn(0x7f13b8009110 legacy=0x7f13b80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.088+0000 7f13d57fa640 1 -- 172.21.15.73:0/128670451 >> v1:172.21.15.73:6789/0 conn(0x7f13b8009110 legacy=0x7f13b80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.118 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:52.118 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 174528, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:52.119 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 3, 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.120 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.121 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.122 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:52.123 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.124 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:52.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:52.127 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.128 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.129 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.130 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.132 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.133 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.134 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.135 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:52.136 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.138 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:52.139 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:52.140 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.141 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:52.142 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.143 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.144 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.146 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.148 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.149 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.150 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.151 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:52.152 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:52.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 >> v1:172.21.15.203:6812/2311533528 conn(0x7f13c40406f0 legacy=0x7f13c4042bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13df0e2640 10 monclient: shutdown 2024-09-11T02:00:52.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13df0e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 >> v1:172.21.15.203:6791/0 conn(0x7f13d8138d40 legacy=0x7f13d809f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13dd67f640 1 -- 172.21.15.73:0/128670451 reap_dead start 2024-09-11T02:00:52.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13dd67f640 1 -- 172.21.15.73:0/128670451 reap_dead start 2024-09-11T02:00:52.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 shutdown_connections 2024-09-11T02:00:52.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 >> 172.21.15.73:0/128670451 conn(0x7f13d80a8050 msgr2=0x7f13d813ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 shutdown_connections 2024-09-11T02:00:52.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.089+0000 7f13df0e2640 1 -- 172.21.15.73:0/128670451 wait complete. 2024-09-11T02:00:52.155 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:52.155 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-11T02:00:52.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T02:00:52.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.253+0000 7fa6371e8640 10 monclient: get_monmap_and_config 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.253+0000 7fa6371e8640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.253+0000 7fa6371e8640 10 monclient: monmap: 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:52.254047+0000 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:52.254047+0000 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.255 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.256 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.256 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.256 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.256 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.256 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.256 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.253+0000 7fa6371e8640 1 Processor -- start 2024-09-11T02:00:52.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.253+0000 7fa6371e8640 1 -- start start 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.253+0000 7fa6371e8640 10 monclient: init 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 10 monclient: _add_conns ranks=[7,8,5,3,4,1,6,2,0] 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 10 monclient(hunting): picked mon.noname-i con 0x7fa630138960 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 10 monclient(hunting): picked mon.noname-e con 0x7fa630139450 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 10 monclient(hunting): picked mon.noname-h con 0x7fa63013f620 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa63009d030 con 0x7fa63013f620 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa63009d310 con 0x7fa630138960 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa63006f770 con 0x7fa630139450 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa6371e8640 10 monclient(hunting): authenticate will time out at 893.858519s 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62ffff640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fa630139450 0x7fa63013df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53592/0 (socket says 172.21.15.73:53592) 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62ffff640 1 -- 172.21.15.73:0/2911873784 learned_addr learned my addr 172.21.15.73:0/2911873784 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254741624 0 0) 0x7fa63006f770 con 0x7fa630139450 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 10 monclient(hunting): my global_id is 114236 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa618003520 con 0x7fa630139450 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522028324 0 0) 0x7fa63009d310 con 0x7fa630138960 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.254+0000 7fa62f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient(hunting): my global_id is 5074 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa63006f770 con 0x7fa630138960 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446236240 0 0) 0x7fa63009d030 con 0x7fa63013f620 2024-09-11T02:00:52.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient(hunting): my global_id is 5225 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa63009d310 con 0x7fa63013f620 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3928046655 0 0) 0x7fa618003520 con 0x7fa630139450 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 >> v1:172.21.15.203:6792/0 conn(0x7fa630138960 legacy=0x7fa630138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 >> v1:172.21.15.203:6791/0 conn(0x7fa63013f620 legacy=0x7fa630141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 monclient: found mon.noname-e 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:00:52.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6300a7360 con 0x7fa630139450 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 5 monclient: authenticate success, global_id 114236 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa624001830 con 0x7fa630139450 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: dump: 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.272 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.273 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa624001a50 con 0x7fa630139450 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 4 set_mon_vals no callback set 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 1 -- 172.21.15.73:0/2911873784 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa624004be0 con 0x7fa630139450 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa62f7fe640 10 monclient: dump: 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.275 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 10 monclient: shutdown 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 1 -- 172.21.15.73:0/2911873784 >> v1:172.21.15.73:6793/0 conn(0x7fa630139450 legacy=0x7fa63013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 1 -- 172.21.15.73:0/2911873784 shutdown_connections 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 1 -- 172.21.15.73:0/2911873784 >> 172.21.15.73:0/2911873784 conn(0x7fa6300a8050 msgr2=0x7fa6300a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 1 -- 172.21.15.73:0/2911873784 shutdown_connections 2024-09-11T02:00:52.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.255+0000 7fa6371e8640 1 -- 172.21.15.73:0/2911873784 wait complete. 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.256+0000 7fa6371e8640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.256+0000 7fa6371e8640 10 monclient: monmap: 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.277 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.256+0000 7fa6371e8640 1 Processor -- start 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.256+0000 7fa6371e8640 1 -- start start 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.256+0000 7fa6371e8640 10 monclient: init 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 10 monclient: _add_conns ranks=[4,0,2,5,8,3,1,7,6] 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 10 monclient(hunting): picked mon.noname-c con 0x7fa630138960 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 10 monclient(hunting): picked mon.noname-a con 0x7fa630139450 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 10 monclient(hunting): picked mon.noname-b con 0x7fa63013f620 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa630142a30 con 0x7fa630139450 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa63013f050 con 0x7fa63013f620 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa63013b450 con 0x7fa630138960 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa6371e8640 10 monclient(hunting): authenticate will time out at 893.861355s 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa634f84640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fa630138960 0x7fa630137d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40346/0 (socket says 172.21.15.73:40346) 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa634f84640 1 -- 172.21.15.73:0/942599391 learned_addr learned my addr 172.21.15.73:0/942599391 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287946612 0 0) 0x7fa6300a7360 con 0x7fa630139450 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): my global_id is 5337 2024-09-11T02:00:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa61c003520 con 0x7fa630139450 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847592094 0 0) 0x7fa63013b450 con 0x7fa630138960 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): my global_id is 5071 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6300a7360 con 0x7fa630138960 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957402267 0 0) 0x7fa63013f050 con 0x7fa63013f620 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): my global_id is 5177 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa63013b450 con 0x7fa63013f620 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 492106977 0 0) 0x7fa6300a7360 con 0x7fa630138960 2024-09-11T02:00:52.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa63013f050 con 0x7fa630138960 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa628001e50 con 0x7fa630138960 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): dump: 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.281 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1979703999 0 0) 0x7fa61c003520 con 0x7fa630139450 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.257+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6300a7360 con 0x7fa630139450 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4203149675 0 0) 0x7fa63013b450 con 0x7fa63013f620 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa61c003520 con 0x7fa63013f620 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa624004b20 con 0x7fa630139450 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient(hunting): dump: 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.283 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.284 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa6200017d0 con 0x7fa63013f620 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient(hunting): dump: 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 471581320 0 0) 0x7fa63013f050 con 0x7fa630138960 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 >> v1:172.21.15.73:6790/0 conn(0x7fa63013f620 legacy=0x7fa6301d5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 >> v1:172.21.15.73:6789/0 conn(0x7fa630139450 legacy=0x7fa6301d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 monclient: found mon.c 2024-09-11T02:00:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:52.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63013c690 con 0x7fa630138960 2024-09-11T02:00:52.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa6371e8640 5 monclient: authenticate success, global_id 5071 2024-09-11T02:00:52.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa6371e8640 10 monclient: _renew_subs 2024-09-11T02:00:52.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa6371e8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:52.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa63013c970 con 0x7fa630138960 2024-09-11T02:00:52.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa6371e8640 10 monclient: _renew_subs 2024-09-11T02:00:52.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa6371e8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:52.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa63013eb80 con 0x7fa630138960 2024-09-11T02:00:52.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa628003c40 con 0x7fa630138960 2024-09-11T02:00:52.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa6280041f0 con 0x7fa630138960 2024-09-11T02:00:52.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62effd640 4 set_mon_vals no callback set 2024-09-11T02:00:52.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:52.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.258+0000 7fa62d7fa640 10 monclient: dump: 2024-09-11T02:00:52.289 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.289 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.289 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.289 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.289 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.290 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.291 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa6371e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa6100065c0 con 0x7fa610002860 2024-09-11T02:00:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fa628004410 con 0x7fa630138960 2024-09-11T02:00:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(119..119 src has 1..119) ==== 3898+0+0 (unknown 3361825829 0 0) 0x7fa62804e820 con 0x7fa630138960 2024-09-11T02:00:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180142870 0 0) 0x7fa6100065c0 con 0x7fa610002860 2024-09-11T02:00:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 10 monclient(hunting): my global_id is 5186 2024-09-11T02:00:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa63013f050 con 0x7fa610002860 2024-09-11T02:00:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1558919389 0 0) 0x7fa63013f050 con 0x7fa610002860 2024-09-11T02:00:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6100065c0 con 0x7fa610002860 2024-09-11T02:00:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa624001950 con 0x7fa610002860 2024-09-11T02:00:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 10 monclient: dump: 2024-09-11T02:00:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.295 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.295 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.295 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.295 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa635785640 10 monclient: get_auth_request con 0x7fa61c0406e0 auth_method 0 2024-09-11T02:00:52.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 26342778 0 0) 0x7fa6100065c0 con 0x7fa610002860 2024-09-11T02:00:52.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.259+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa61000a160 con 0x7fa610002860 2024-09-11T02:00:52.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.260+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa6240072c0 con 0x7fa610002860 2024-09-11T02:00:52.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.260+0000 7fa62d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.260+0000 7fa62d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:52.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.260+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 >> v1:172.21.15.73:6790/0 conn(0x7fa610002860 legacy=0x7fa610004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.260+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 >> v1:172.21.15.73:6790/0 conn(0x7fa610002860 legacy=0x7fa610004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa6371e8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:52.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa610009e70 con 0x7fa610009130 2024-09-11T02:00:52.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145249968 0 0) 0x7fa610009e70 con 0x7fa610009130 2024-09-11T02:00:52.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 10 monclient(hunting): my global_id is 5195 2024-09-11T02:00:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6100065c0 con 0x7fa610009130 2024-09-11T02:00:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 926201414 0 0) 0x7fa6100065c0 con 0x7fa610009130 2024-09-11T02:00:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa610009e70 con 0x7fa610009130 2024-09-11T02:00:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa6240059e0 con 0x7fa610009130 2024-09-11T02:00:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:52.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 10 monclient: dump: 2024-09-11T02:00:52.298 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.298 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.298 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.298 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.298 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.298 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.298 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.299 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.299 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.299 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.299 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.299 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.299 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.299 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.299 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.299 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4091070635 0 0) 0x7fa610009e70 con 0x7fa610009130 2024-09-11T02:00:52.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.266+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 --> v1:172.21.15.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa61000c410 con 0x7fa610009130 2024-09-11T02:00:52.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7880 (unknown 0 0 3502426525) 0x7fa624006ef0 con 0x7fa610009130 2024-09-11T02:00:52.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa62d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:52.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa62d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:52.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 >> v1:172.21.15.73:6790/0 conn(0x7fa610009130 legacy=0x7fa6100095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa62d7fa640 1 -- 172.21.15.73:0/942599391 >> v1:172.21.15.73:6790/0 conn(0x7fa610009130 legacy=0x7fa6100095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.301 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:52.301 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:52.301 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:52.301 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-09-11T02:00:52.301 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:52.301 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 174724, 2024-09-11T02:00:52.301 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:52.301 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 3, 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:52.302 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:52.303 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.304 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:52.305 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.306 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.307 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.308 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.310 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.310 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.310 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.310 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.310 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.310 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.311 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.312 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.314 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.315 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.316 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.317 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.319 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.319 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.319 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.321 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.321 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.321 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.321 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.321 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.321 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.321 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.321 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.321 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.322 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.322 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:52.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:52.322 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.322 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.322 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.322 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.322 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.323 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.324 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:52.325 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:52.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 >> v1:172.21.15.203:6812/2311533528 conn(0x7fa61c0406e0 legacy=0x7fa61c042ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa6371e8640 10 monclient: shutdown 2024-09-11T02:00:52.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa6371e8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 >> v1:172.21.15.73:6791/0 conn(0x7fa630138960 legacy=0x7fa630137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa635785640 1 -- 172.21.15.73:0/942599391 reap_dead start 2024-09-11T02:00:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa635785640 1 -- 172.21.15.73:0/942599391 reap_dead start 2024-09-11T02:00:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 shutdown_connections 2024-09-11T02:00:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 >> 172.21.15.73:0/942599391 conn(0x7fa6300a8050 msgr2=0x7fa630141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 shutdown_connections 2024-09-11T02:00:52.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.267+0000 7fa6371e8640 1 -- 172.21.15.73:0/942599391 wait complete. 2024-09-11T02:00:52.329 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:52.329 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-11T02:00:52.330 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T02:00:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.426+0000 7f4e81a65640 10 monclient: get_monmap_and_config 2024-09-11T02:00:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.426+0000 7f4e81a65640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.426+0000 7f4e81a65640 10 monclient: monmap: 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:52.427723+0000 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:52.427723+0000 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.430 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.427+0000 7f4e81a65640 1 Processor -- start 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.427+0000 7f4e81a65640 1 -- start start 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.427+0000 7f4e81a65640 10 monclient: init 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 10 monclient: _add_conns ranks=[3,6,5,0,4,8,1,2,7] 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 10 monclient(hunting): picked mon.noname-g con 0x7f4e7c138960 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 10 monclient(hunting): picked mon.noname-d con 0x7f4e7c139450 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 10 monclient(hunting): picked mon.noname-h con 0x7f4e7c13f620 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c09d030 con 0x7f4e7c138960 2024-09-11T02:00:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c09d310 con 0x7f4e7c13f620 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c06f770 con 0x7f4e7c139450 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 10 monclient(hunting): authenticate will time out at 894.032243s 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7affd640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f4e7c139450 0x7f4e7c13df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:41014/0 (socket says 172.21.15.73:41014) 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7affd640 1 -- 172.21.15.73:0/3555857185 learned_addr learned my addr 172.21.15.73:0/3555857185 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265036672 0 0) 0x7f4e7c06f770 con 0x7f4e7c139450 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): my global_id is 114234 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e68003520 con 0x7f4e7c139450 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2843094287 0 0) 0x7f4e7c09d030 con 0x7f4e7c138960 2024-09-11T02:00:52.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): my global_id is 5187 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e7c06f770 con 0x7f4e7c138960 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578953977 0 0) 0x7f4e7c09d310 con 0x7f4e7c13f620 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient(hunting): my global_id is 5234 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e7c09d030 con 0x7f4e7c13f620 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 315416522 0 0) 0x7f4e68003520 con 0x7f4e7c139450 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 >> v1:172.21.15.203:6791/0 conn(0x7f4e7c13f620 legacy=0x7f4e7c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 >> v1:172.21.15.203:6790/0 conn(0x7f4e7c138960 legacy=0x7f4e7c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 monclient: found mon.noname-d 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c0a7360 con 0x7f4e7c139450 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4e6c001830 con 0x7f4e7c139450 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: dump: 2024-09-11T02:00:52.442 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.443 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 5 monclient: authenticate success, global_id 114234 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e6c001a50 con 0x7f4e7c139450 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 1 -- 172.21.15.73:0/3555857185 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4e6c004be0 con 0x7f4e7c139450 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e81a65640 4 set_mon_vals no callback set 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.428+0000 7f4e7a7fc640 10 monclient: dump: 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.444 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.429+0000 7f4e81a65640 10 monclient: shutdown 2024-09-11T02:00:52.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.429+0000 7f4e81a65640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.429+0000 7f4e81a65640 1 -- 172.21.15.73:0/3555857185 >> v1:172.21.15.73:6792/0 conn(0x7f4e7c139450 legacy=0x7f4e7c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.429+0000 7f4e81a65640 1 -- 172.21.15.73:0/3555857185 shutdown_connections 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.429+0000 7f4e81a65640 1 -- 172.21.15.73:0/3555857185 >> 172.21.15.73:0/3555857185 conn(0x7f4e7c0a8050 msgr2=0x7f4e7c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.429+0000 7f4e81a65640 1 -- 172.21.15.73:0/3555857185 shutdown_connections 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.429+0000 7f4e81a65640 1 -- 172.21.15.73:0/3555857185 wait complete. 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.429+0000 7f4e81a65640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.429+0000 7f4e81a65640 10 monclient: monmap: 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.446 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 1 Processor -- start 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 1 -- start start 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 10 monclient: init 2024-09-11T02:00:52.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 10 monclient: _add_conns ranks=[8,7,5,2,1,6,0,3,4] 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 10 monclient(hunting): picked mon.noname-e con 0x7f4e7c138960 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 10 monclient(hunting): picked mon.noname-i con 0x7f4e7c139450 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 10 monclient(hunting): picked mon.noname-h con 0x7f4e7c13f620 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c13f050 con 0x7f4e7c13f620 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c0a2320 con 0x7f4e7c139450 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c0a1cf0 con 0x7f4e7c138960 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.430+0000 7f4e81a65640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e81a65640 10 monclient(hunting): authenticate will time out at 894.035010s 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e7b7fe640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f4e7c138960 0x7f4e7c13e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53602/0 (socket says 172.21.15.73:53602) 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e7b7fe640 1 -- 172.21.15.73:0/2996589344 learned_addr learned my addr 172.21.15.73:0/2996589344 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364552546 0 0) 0x7f4e7c0a1cf0 con 0x7f4e7c138960 2024-09-11T02:00:52.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): my global_id is 114245 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e5c003520 con 0x7f4e7c138960 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3518562620 0 0) 0x7f4e7c13f050 con 0x7f4e7c13f620 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): my global_id is 5243 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e7c0a1cf0 con 0x7f4e7c13f620 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950582917 0 0) 0x7f4e7c0a2320 con 0x7f4e7c139450 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): my global_id is 5083 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e7c13f050 con 0x7f4e7c139450 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1707369401 0 0) 0x7f4e5c003520 con 0x7f4e7c138960 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e7c0a2320 con 0x7f4e7c138960 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4e64001b50 con 0x7f4e7c138960 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): dump: 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.450 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.451 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3944186583 0 0) 0x7f4e7c0a2320 con 0x7f4e7c138960 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 >> v1:172.21.15.203:6792/0 conn(0x7f4e7c139450 legacy=0x7f4e7c1d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 >> v1:172.21.15.203:6791/0 conn(0x7f4e7c13f620 legacy=0x7f4e7c1d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 monclient: found mon.e 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:52.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c13ca80 con 0x7f4e7c138960 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e81a65640 5 monclient: authenticate success, global_id 114245 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e81a65640 10 monclient: _renew_subs 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e81a65640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c0a15a0 con 0x7f4e7c138960 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e81a65640 10 monclient: _renew_subs 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e81a65640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4e7c13b460 con 0x7f4e7c138960 2024-09-11T02:00:52.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e640038c0 con 0x7f4e7c138960 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4e64003db0 con 0x7f4e7c138960 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e79ffb640 4 set_mon_vals no callback set 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.431+0000 7f4e73fff640 10 monclient: dump: 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.454 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.455 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.455 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.455 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.455 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.455 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e81a65640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4e600065c0 con 0x7f4e60002860 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f4e64003f50 con 0x7f4e7c138960 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(119..119 src has 1..119) ==== 3898+0+0 (unknown 3361825829 0 0) 0x7f4e6404e530 con 0x7f4e7c138960 2024-09-11T02:00:52.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872606359 0 0) 0x7f4e600065c0 con 0x7f4e60002860 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e73fff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e73fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e73fff640 10 monclient(hunting): my global_id is 5080 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.432+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e7c0a2320 con 0x7f4e60002860 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e7bfff640 10 monclient: get_auth_request con 0x7f4e5c03fcb0 auth_method 0 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2250001965 0 0) 0x7f4e7c0a2320 con 0x7f4e60002860 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e600065c0 con 0x7f4e60002860 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4e6c0017f0 con 0x7f4e60002860 2024-09-11T02:00:52.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 10 monclient: dump: 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.458 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3400594664 0 0) 0x7f4e600065c0 con 0x7f4e60002860 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e6000a160 con 0x7f4e60002860 2024-09-11T02:00:52.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4e6c0049d0 con 0x7f4e60002860 2024-09-11T02:00:52.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:52.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 >> v1:172.21.15.73:6791/0 conn(0x7f4e60002860 legacy=0x7f4e60004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.433+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 >> v1:172.21.15.73:6791/0 conn(0x7f4e60002860 legacy=0x7f4e60004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.439+0000 7f4e81a65640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:52.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.439+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4e60009e20 con 0x7f4e600090e0 2024-09-11T02:00:52.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800602093 0 0) 0x7f4e60009e20 con 0x7f4e600090e0 2024-09-11T02:00:52.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 10 monclient(hunting): my global_id is 5089 2024-09-11T02:00:52.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e600065c0 con 0x7f4e600090e0 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2866212827 0 0) 0x7f4e600065c0 con 0x7f4e600090e0 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e60009e20 con 0x7f4e600090e0 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4e6c005000 con 0x7f4e600090e0 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 10 monclient: dump: 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.463 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 608144331 0 0) 0x7f4e60009e20 con 0x7f4e600090e0 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 --> v1:172.21.15.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4e6000c3f0 con 0x7f4e600090e0 2024-09-11T02:00:52.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 2107554123) 0x7f4e6c0071e0 con 0x7f4e600090e0 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 >> v1:172.21.15.73:6791/0 conn(0x7f4e600090e0 legacy=0x7f4e60009570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e73fff640 1 -- 172.21.15.73:0/2996589344 >> v1:172.21.15.73:6791/0 conn(0x7f4e600090e0 legacy=0x7f4e60009570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:52.465 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 174903, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:00:52.466 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.467 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.468 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:52.470 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.470 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.470 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:52.470 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:52.470 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:52.470 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:52.471 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:52.471 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:52.471 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:52.471 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.471 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:52.471 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.472 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.472 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.472 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.472 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.472 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.473 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.473 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.473 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.473 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.473 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.473 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:52.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:52.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.474 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:52.474 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:52.474 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.475 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.475 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.475 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:52.475 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.475 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.476 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.476 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.476 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.477 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.477 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.477 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.477 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:52.478 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:52.478 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.478 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.478 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.479 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:52.479 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.479 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.479 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.480 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.480 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.480 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.480 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.480 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.481 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:52.481 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:52.481 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.481 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.482 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:52.482 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.482 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.482 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.483 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.483 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.483 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.483 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.484 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.484 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:52.484 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:52.484 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.485 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.485 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.485 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:52.485 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.485 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.486 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.486 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.486 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.486 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.486 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.487 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.487 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:52.487 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:52.487 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.488 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.488 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.488 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:52.488 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.489 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.489 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.489 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.489 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.489 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.490 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.490 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.490 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:52.490 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:52.491 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.491 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:52.491 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.492 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.492 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.492 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.493 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.493 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.493 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.496 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:52.496 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:52.497 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.497 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.497 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.497 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:52.498 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.498 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.498 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.498 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.498 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.498 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.498 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.499 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.499 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.499 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:52.499 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:52.499 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.500 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.500 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.500 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:52.500 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.500 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.500 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.500 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.501 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:52.502 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.504 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.504 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:52.504 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 >> v1:172.21.15.203:6812/2311533528 conn(0x7f4e5c03fcb0 legacy=0x7f4e5c042170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e81a65640 10 monclient: shutdown 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e81a65640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 >> v1:172.21.15.73:6793/0 conn(0x7f4e7c138960 legacy=0x7f4e7c13e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e7bfff640 1 -- 172.21.15.73:0/2996589344 reap_dead start 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e7bfff640 1 -- 172.21.15.73:0/2996589344 reap_dead start 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 shutdown_connections 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.440+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 >> 172.21.15.73:0/2996589344 conn(0x7f4e7c0a8050 msgr2=0x7f4e7c141c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.441+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 shutdown_connections 2024-09-11T02:00:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.441+0000 7f4e81a65640 1 -- 172.21.15.73:0/2996589344 wait complete. 2024-09-11T02:00:52.507 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:52.507 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-11T02:00:52.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-11T02:00:52.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.611+0000 7fb4928be640 10 monclient: get_monmap_and_config 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.611+0000 7fb4928be640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.611+0000 7fb4928be640 10 monclient: monmap: 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:52.612127+0000 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:52.612127+0000 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.613 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.614 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.614 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.614 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.614 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.611+0000 7fb4928be640 1 Processor -- start 2024-09-11T02:00:52.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 1 -- start start 2024-09-11T02:00:52.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 10 monclient: init 2024-09-11T02:00:52.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 10 monclient: _add_conns ranks=[7,0,8,4,3,2,1,5,6] 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 10 monclient(hunting): picked mon.noname-i con 0x7fb48c138960 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 10 monclient(hunting): picked mon.noname-a con 0x7fb48c139450 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 10 monclient(hunting): picked mon.noname-e con 0x7fb48c13f620 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48c09d030 con 0x7fb48c139450 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48c09d310 con 0x7fb48c138960 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48c06f770 con 0x7fb48c13f620 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb4928be640 10 monclient(hunting): authenticate will time out at 894.216598s 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb490e5b640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fb48c13f620 0x7fb48c141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53618/0 (socket says 172.21.15.73:53618) 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb490e5b640 1 -- 172.21.15.73:0/3583412201 learned_addr learned my addr 172.21.15.73:0/3583412201 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb48c139450 0x7fb48c13df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47128/0 (socket says 172.21.15.73:47128) 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666542172 0 0) 0x7fb48c06f770 con 0x7fb48c13f620 2024-09-11T02:00:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 10 monclient(hunting): my global_id is 114254 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb474003520 con 0x7fb48c13f620 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853709589 0 0) 0x7fb48c09d030 con 0x7fb48c139450 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 10 monclient(hunting): my global_id is 5346 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.612+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb48c06f770 con 0x7fb48c139450 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 52479832 0 0) 0x7fb474003520 con 0x7fb48c13f620 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 >> v1:172.21.15.203:6792/0 conn(0x7fb48c138960 legacy=0x7fb48c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 >> v1:172.21.15.73:6789/0 conn(0x7fb48c139450 legacy=0x7fb48c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 1 monclient: found mon.noname-e 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48c0a7360 con 0x7fb48c13f620 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb484001bb0 con 0x7fb48c13f620 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 5 monclient: authenticate success, global_id 114254 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: dump: 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.627 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb484001d50 con 0x7fb48c13f620 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 1 -- 172.21.15.73:0/3583412201 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb484004f60 con 0x7fb48c13f620 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 4 set_mon_vals no callback set 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb48affd640 10 monclient: dump: 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.629 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 10 monclient: shutdown 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 1 -- 172.21.15.73:0/3583412201 >> v1:172.21.15.73:6793/0 conn(0x7fb48c13f620 legacy=0x7fb48c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 1 -- 172.21.15.73:0/3583412201 shutdown_connections 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 1 -- 172.21.15.73:0/3583412201 >> 172.21.15.73:0/3583412201 conn(0x7fb48c0a8050 msgr2=0x7fb48c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 1 -- 172.21.15.73:0/3583412201 shutdown_connections 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.613+0000 7fb4928be640 1 -- 172.21.15.73:0/3583412201 wait complete. 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.614+0000 7fb4928be640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.614+0000 7fb4928be640 10 monclient: monmap: 2024-09-11T02:00:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.614+0000 7fb4928be640 1 Processor -- start 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.614+0000 7fb4928be640 1 -- start start 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.614+0000 7fb4928be640 10 monclient: init 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 10 monclient: _add_conns ranks=[3,5,2,8,0,7,6,1,4] 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 10 monclient(hunting): picked mon.noname-g con 0x7fb48c138960 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 10 monclient(hunting): picked mon.noname-h con 0x7fb48c139450 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 10 monclient(hunting): picked mon.noname-b con 0x7fb48c13f620 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48c13e8b0 con 0x7fb48c13f620 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48c13aaf0 con 0x7fb48c138960 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48c13f410 con 0x7fb48c139450 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb4928be640 10 monclient(hunting): authenticate will time out at 894.219414s 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb490e5b640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb48c13f620 0x7fb48c1d58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:39798/0 (socket says 172.21.15.73:39798) 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb490e5b640 1 -- 172.21.15.73:0/2920874843 learned_addr learned my addr 172.21.15.73:0/2920874843 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671338873 0 0) 0x7fb48c13e8b0 con 0x7fb48c13f620 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): my global_id is 5204 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb478003520 con 0x7fb48c13f620 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343864245 0 0) 0x7fb48c13aaf0 con 0x7fb48c138960 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): my global_id is 5196 2024-09-11T02:00:52.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb48c13e8b0 con 0x7fb48c138960 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 389302661 0 0) 0x7fb48c13f410 con 0x7fb48c139450 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): my global_id is 5252 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb48c13aaf0 con 0x7fb48c139450 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3760888828 0 0) 0x7fb478003520 con 0x7fb48c13f620 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb48c13f410 con 0x7fb48c13f620 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb484001bb0 con 0x7fb48c13f620 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): dump: 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.615+0000 7fb488ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3983439771 0 0) 0x7fb48c13e8b0 con 0x7fb48c138960 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb478003520 con 0x7fb48c138960 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb47c001a50 con 0x7fb48c138960 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient(hunting): dump: 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.636 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 763056616 0 0) 0x7fb48c13f410 con 0x7fb48c13f620 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 >> v1:172.21.15.203:6791/0 conn(0x7fb48c139450 legacy=0x7fb48c13a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 >> v1:172.21.15.203:6790/0 conn(0x7fb48c138960 legacy=0x7fb48c139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 monclient: found mon.b 2024-09-11T02:00:52.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48c0a50d0 con 0x7fb48c13f620 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb4928be640 5 monclient: authenticate success, global_id 5204 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb4928be640 10 monclient: _renew_subs 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb4928be640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb48c13ca80 con 0x7fb48c13f620 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb4928be640 10 monclient: _renew_subs 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb4928be640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb48c0a4a00 con 0x7fb48c13f620 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb484004e90 con 0x7fb48c13f620 2024-09-11T02:00:52.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb48a7fc640 4 set_mon_vals no callback set 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb484005440 con 0x7fb48c13f620 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.616+0000 7fb488ff9640 10 monclient: dump: 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.639 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb4928be640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb46c0065c0 con 0x7fb46c002860 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fb484011b80 con 0x7fb48c13f620 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(119..119 src has 1..119) ==== 3898+0+0 (unknown 3361825829 0 0) 0x7fb48404e6e0 con 0x7fb48c13f620 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883421849 0 0) 0x7fb46c0065c0 con 0x7fb46c002860 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 10 monclient(hunting): my global_id is 114243 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb48c13f410 con 0x7fb46c002860 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb48b7fe640 10 monclient: get_auth_request con 0x7fb478040230 auth_method 0 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3419187696 0 0) 0x7fb48c13f410 con 0x7fb46c002860 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb46c0065c0 con 0x7fb46c002860 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb47c003930 con 0x7fb46c002860 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 10 monclient: dump: 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.641 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.642 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.643 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3824746149 0 0) 0x7fb46c0065c0 con 0x7fb46c002860 2024-09-11T02:00:52.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.617+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb46c00a160 con 0x7fb46c002860 2024-09-11T02:00:52.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.618+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb47c003d60 con 0x7fb46c002860 2024-09-11T02:00:52.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.618+0000 7fb488ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.618+0000 7fb488ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:52.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.618+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 >> v1:172.21.15.73:6792/0 conn(0x7fb46c002860 legacy=0x7fb46c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.618+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 >> v1:172.21.15.73:6792/0 conn(0x7fb46c002860 legacy=0x7fb46c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.625+0000 7fb4928be640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.625+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb46c009e50 con 0x7fb46c009110 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885678390 0 0) 0x7fb46c009e50 con 0x7fb46c009110 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 10 monclient(hunting): my global_id is 114252 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb46c0065c0 con 0x7fb46c009110 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 787571875 0 0) 0x7fb46c0065c0 con 0x7fb46c009110 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb46c009e50 con 0x7fb46c009110 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb47c004640 con 0x7fb46c009110 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:52.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.628+0000 7fb488ff9640 10 monclient: dump: 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.647 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.629+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2217784448 0 0) 0x7fb46c009e50 con 0x7fb46c009110 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.629+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 --> v1:172.21.15.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb46c00c3f0 con 0x7fb46c009110 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.630+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 3425966215) 0x7fb47c006680 con 0x7fb46c009110 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.630+0000 7fb488ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.630+0000 7fb488ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.630+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 >> v1:172.21.15.73:6792/0 conn(0x7fb46c009110 legacy=0x7fb46c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.630+0000 7fb488ff9640 1 -- 172.21.15.73:0/2920874843 >> v1:172.21.15.73:6792/0 conn(0x7fb46c009110 legacy=0x7fb46c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.648 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 19217, 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:52.649 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.650 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.651 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:52.652 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.653 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:52.654 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.655 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.656 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:52.656 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:52.656 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.656 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.656 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.656 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.656 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:52.657 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.658 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.659 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.660 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.661 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.662 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.663 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:52.665 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:52.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.668 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:52.668 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:52.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 >> v1:172.21.15.203:6812/2311533528 conn(0x7fb478040230 legacy=0x7fb4780426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb4928be640 10 monclient: shutdown 2024-09-11T02:00:52.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb4928be640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 >> v1:172.21.15.73:6790/0 conn(0x7fb48c13f620 legacy=0x7fb48c1d58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb490e5b640 1 -- 172.21.15.73:0/2920874843 reap_dead start 2024-09-11T02:00:52.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb490e5b640 1 -- 172.21.15.73:0/2920874843 reap_dead start 2024-09-11T02:00:52.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 shutdown_connections 2024-09-11T02:00:52.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 >> 172.21.15.73:0/2920874843 conn(0x7fb48c0a8050 msgr2=0x7fb48c0a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 shutdown_connections 2024-09-11T02:00:52.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.631+0000 7fb4928be640 1 -- 172.21.15.73:0/2920874843 wait complete. 2024-09-11T02:00:52.670 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:52.670 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-11T02:00:52.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-11T02:00:52.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36553]: starting. 2024-09-11T02:00:52.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36553]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36552 2024-09-11T02:00:52.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36553]: created object 0... 2024-09-11T02:00:52.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36553]: created object 25... 2024-09-11T02:00:52.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36553]: created object 49... 2024-09-11T02:00:52.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36553]: finishing. 2024-09-11T02:00:52.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36553]: shutting down. 2024-09-11T02:00:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.769+0000 7eff817e2640 10 monclient: get_monmap_and_config 2024-09-11T02:00:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.769+0000 7eff817e2640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.769+0000 7eff817e2640 10 monclient: monmap: 2024-09-11T02:00:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:52.770362+0000 2024-09-11T02:00:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:52.770362+0000 2024-09-11T02:00:52.771 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.772 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 1 Processor -- start 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 1 -- start start 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 10 monclient: init 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 10 monclient: _add_conns ranks=[2,4,5,7,6,0,1,3,8] 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 10 monclient(hunting): picked mon.noname-b con 0x7eff7c138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 10 monclient(hunting): picked mon.noname-c con 0x7eff7c0a72f0 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 10 monclient(hunting): picked mon.noname-h con 0x7eff7c13f350 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c09ca00 con 0x7eff7c138d40 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c0a7070 con 0x7eff7c0a72f0 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c09cee0 con 0x7eff7c13f350 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff817e2640 10 monclient(hunting): authenticate will time out at 894.374783s 2024-09-11T02:00:52.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff73fff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7eff7c0a72f0 0x7eff7c13dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40368/0 (socket says 172.21.15.73:40368) 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.770+0000 7eff73fff640 1 -- 172.21.15.73:0/636121750 learned_addr learned my addr 172.21.15.73:0/636121750 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081021256 0 0) 0x7eff7c09ca00 con 0x7eff7c138d40 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient(hunting): my global_id is 5213 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff68003520 con 0x7eff7c138d40 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779337302 0 0) 0x7eff7c0a7070 con 0x7eff7c0a72f0 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient(hunting): my global_id is 5098 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff7c09ca00 con 0x7eff7c0a72f0 2024-09-11T02:00:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2118508965 0 0) 0x7eff68003520 con 0x7eff7c138d40 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 >> v1:172.21.15.203:6791/0 conn(0x7eff7c13f350 legacy=0x7eff7c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 >> v1:172.21.15.73:6791/0 conn(0x7eff7c0a72f0 legacy=0x7eff7c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 monclient: found mon.noname-b 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c09d1c0 con 0x7eff7c138d40 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7eff6c001850 con 0x7eff7c138d40 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff817e2640 5 monclient: authenticate success, global_id 5213 2024-09-11T02:00:52.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff817e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: dump: 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.788 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff817e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff6c001a70 con 0x7eff7c138d40 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 1 -- 172.21.15.73:0/636121750 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7eff6c003950 con 0x7eff7c138d40 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff817e2640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff817e2640 4 set_mon_vals no callback set 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff7a7fc640 10 monclient: dump: 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.790 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff817e2640 10 monclient: shutdown 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff817e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.771+0000 7eff817e2640 1 -- 172.21.15.73:0/636121750 >> v1:172.21.15.73:6790/0 conn(0x7eff7c138d40 legacy=0x7eff7c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.772+0000 7eff817e2640 1 -- 172.21.15.73:0/636121750 shutdown_connections 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.772+0000 7eff817e2640 1 -- 172.21.15.73:0/636121750 >> 172.21.15.73:0/636121750 conn(0x7eff7c0a8050 msgr2=0x7eff7c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.772+0000 7eff817e2640 1 -- 172.21.15.73:0/636121750 shutdown_connections 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.772+0000 7eff817e2640 1 -- 172.21.15.73:0/636121750 wait complete. 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.772+0000 7eff817e2640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.772+0000 7eff817e2640 10 monclient: monmap: 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.791 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.792 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.772+0000 7eff817e2640 1 Processor -- start 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.772+0000 7eff817e2640 1 -- start start 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.772+0000 7eff817e2640 10 monclient: init 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 10 monclient: _add_conns ranks=[8,2,6,5,0,7,4,3,1] 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 10 monclient(hunting): picked mon.noname-e con 0x7eff7c0a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 10 monclient(hunting): picked mon.noname-b con 0x7eff7c138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 10 monclient(hunting): picked mon.noname-d con 0x7eff7c13f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c0a52f0 con 0x7eff7c138d40 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c140550 con 0x7eff7c13f350 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7c13ea30 con 0x7eff7c0a72f0 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff817e2640 10 monclient(hunting): authenticate will time out at 894.377423s 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff7affd640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7eff7c0a72f0 0x7eff7c13f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53622/0 (socket says 172.21.15.73:53622) 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff7affd640 1 -- 172.21.15.73:0/613200787 learned_addr learned my addr 172.21.15.73:0/613200787 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101669139 0 0) 0x7eff7c13ea30 con 0x7eff7c0a72f0 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): my global_id is 114263 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff5c003550 con 0x7eff7c0a72f0 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2716677634 0 0) 0x7eff7c09ca00 con 0x7eff7c138d40 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): my global_id is 5222 2024-09-11T02:00:52.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff7c13ea30 con 0x7eff7c138d40 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183239033 0 0) 0x7eff7c140550 con 0x7eff7c13f350 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): my global_id is 114261 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff7c09ca00 con 0x7eff7c13f350 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1489474771 0 0) 0x7eff5c003550 con 0x7eff7c0a72f0 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff7c140550 con 0x7eff7c0a72f0 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7eff6c003930 con 0x7eff7c0a72f0 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): dump: 2024-09-11T02:00:52.795 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.796 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.773+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1969257619 0 0) 0x7eff7c13ea30 con 0x7eff7c138d40 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff5c003550 con 0x7eff7c138d40 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7eff64001a00 con 0x7eff7c138d40 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient(hunting): dump: 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.797 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2224312819 0 0) 0x7eff7c09ca00 con 0x7eff7c13f350 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff7c13ea30 con 0x7eff7c13f350 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7eff74001c70 con 0x7eff7c13f350 2024-09-11T02:00:52.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient(hunting): dump: 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.799 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 181342849 0 0) 0x7eff7c140550 con 0x7eff7c0a72f0 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 >> v1:172.21.15.73:6792/0 conn(0x7eff7c13f350 legacy=0x7eff7c1d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 >> v1:172.21.15.73:6790/0 conn(0x7eff7c138d40 legacy=0x7eff7c13fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 monclient: found mon.e 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c1428d0 con 0x7eff7c0a72f0 2024-09-11T02:00:52.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff817e2640 5 monclient: authenticate success, global_id 114263 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff817e2640 10 monclient: _renew_subs 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff817e2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff7c1418a0 con 0x7eff7c0a72f0 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff817e2640 10 monclient: _renew_subs 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff817e2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7eff7c0a1620 con 0x7eff7c0a72f0 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff6c001210 con 0x7eff7c0a72f0 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7eff6c003f90 con 0x7eff7c0a72f0 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff79ffb640 4 set_mon_vals no callback set 2024-09-11T02:00:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.774+0000 7eff737fe640 10 monclient: dump: 2024-09-11T02:00:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.802 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.803 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff817e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7eff600065c0 con 0x7eff60002860 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7eff6c0018f0 con 0x7eff7c0a72f0 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 221922906 0 0) 0x7eff6c04e360 con 0x7eff7c0a72f0 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994479763 0 0) 0x7eff600065c0 con 0x7eff60002860 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 10 monclient(hunting): my global_id is 114272 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff7c140550 con 0x7eff60002860 2024-09-11T02:00:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff7b7fe640 10 monclient: get_auth_request con 0x7eff5c0405f0 auth_method 0 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3329255219 0 0) 0x7eff7c140550 con 0x7eff60002860 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff600065c0 con 0x7eff60002860 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7eff64004ee0 con 0x7eff60002860 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 10 monclient: dump: 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.805 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 533838060 0 0) 0x7eff600065c0 con 0x7eff60002860 2024-09-11T02:00:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.775+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff6000a160 con 0x7eff60002860 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.776+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7eff64005150 con 0x7eff60002860 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.776+0000 7eff737fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.776+0000 7eff737fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.776+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 >> v1:172.21.15.73:6793/0 conn(0x7eff60002860 legacy=0x7eff60004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.776+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 >> v1:172.21.15.73:6793/0 conn(0x7eff60002860 legacy=0x7eff60004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff817e2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7eff60009e20 con 0x7eff600090e0 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131133190 0 0) 0x7eff60009e20 con 0x7eff600090e0 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 10 monclient(hunting): my global_id is 114281 2024-09-11T02:00:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff600065c0 con 0x7eff600090e0 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3174870829 0 0) 0x7eff600065c0 con 0x7eff600090e0 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff60009e20 con 0x7eff600090e0 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7eff64005930 con 0x7eff600090e0 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 10 monclient: dump: 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 829884086 0 0) 0x7eff60009e20 con 0x7eff600090e0 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 --> v1:172.21.15.73:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7eff6000c3f0 con 0x7eff600090e0 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 3089589882) 0x7eff64007bd0 con 0x7eff600090e0 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 >> v1:172.21.15.73:6793/0 conn(0x7eff600090e0 legacy=0x7eff60009570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.782+0000 7eff737fe640 1 -- 172.21.15.73:0/613200787 >> v1:172.21.15.73:6793/0 conn(0x7eff600090e0 legacy=0x7eff60009570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.810 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:52.810 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:52.810 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:52.810 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:52.810 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:52.810 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 19370, 2024-09-11T02:00:52.810 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:52.810 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:52.811 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:52.812 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:52.814 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.815 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.816 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:52.817 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.818 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.819 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.820 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.821 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.822 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.823 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:52.824 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:52.825 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.825 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.825 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.825 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.825 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:52.825 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.825 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.825 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.825 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.826 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.828 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:52.829 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:52.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.830 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.830 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.830 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.830 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.830 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.830 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:52.830 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.831 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.831 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.831 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:00:52.831 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.831 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.831 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.831 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:52.831 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 >> v1:172.21.15.203:6812/2311533528 conn(0x7eff5c0405f0 legacy=0x7eff5c042ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff817e2640 10 monclient: shutdown 2024-09-11T02:00:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff817e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 >> v1:172.21.15.73:6793/0 conn(0x7eff7c0a72f0 legacy=0x7eff7c13f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff7b7fe640 1 -- 172.21.15.73:0/613200787 reap_dead start 2024-09-11T02:00:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff7b7fe640 1 -- 172.21.15.73:0/613200787 reap_dead start 2024-09-11T02:00:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 shutdown_connections 2024-09-11T02:00:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 >> 172.21.15.73:0/613200787 conn(0x7eff7c0a8050 msgr2=0x7eff7c131b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 shutdown_connections 2024-09-11T02:00:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.783+0000 7eff817e2640 1 -- 172.21.15.73:0/613200787 wait complete. 2024-09-11T02:00:52.833 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:52.834 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-11T02:00:52.834 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.931+0000 7f324b5f3640 10 monclient: get_monmap_and_config 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.931+0000 7f324b5f3640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.931+0000 7f324b5f3640 10 monclient: monmap: 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:52.932214+0000 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:52.932214+0000 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.933 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.934 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.934 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.934 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.934 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.934 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.934 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.934 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.931+0000 7f324b5f3640 1 Processor -- start 2024-09-11T02:00:52.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 1 -- start start 2024-09-11T02:00:52.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 10 monclient: init 2024-09-11T02:00:52.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 10 monclient: _add_conns ranks=[3,6,4,8,2,7,0,1,5] 2024-09-11T02:00:52.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 10 monclient(hunting): picked mon.noname-g con 0x7f3244138960 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:52.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 10 monclient(hunting): picked mon.noname-d con 0x7f3244139450 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:52.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 10 monclient(hunting): picked mon.noname-c con 0x7f324413f620 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324409d030 con 0x7f3244138960 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324409d310 con 0x7f324413f620 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324406f770 con 0x7f3244139450 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f324b5f3640 10 monclient(hunting): authenticate will time out at 894.536748s 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f3248b8e640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f3244139450 0x7f324413df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:41064/0 (socket says 172.21.15.73:41064) 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f3249b90640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f324413f620 0x7f3244141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40372/0 (socket says 172.21.15.73:40372) 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.932+0000 7f3248b8e640 1 -- 172.21.15.73:0/2686639020 learned_addr learned my addr 172.21.15.73:0/2686639020 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1997711251 0 0) 0x7f324406f770 con 0x7f3244139450 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): my global_id is 114270 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3230003520 con 0x7f3244139450 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199984618 0 0) 0x7f324409d310 con 0x7f324413f620 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): my global_id is 5107 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f324406f770 con 0x7f324413f620 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415077342 0 0) 0x7f324409d030 con 0x7f3244138960 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient(hunting): my global_id is 5205 2024-09-11T02:00:52.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f324409d310 con 0x7f3244138960 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2631587284 0 0) 0x7f3230003520 con 0x7f3244139450 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 >> v1:172.21.15.73:6791/0 conn(0x7f324413f620 legacy=0x7f3244141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 >> v1:172.21.15.203:6790/0 conn(0x7f3244138960 legacy=0x7f3244138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 monclient: found mon.noname-d 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32440a7360 con 0x7f3244139450 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3234001830 con 0x7f3244139450 2024-09-11T02:00:52.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f324b5f3640 5 monclient: authenticate success, global_id 114270 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f324b5f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: dump: 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.946 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f324b5f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3234001a50 con 0x7f3244139450 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f324b5f3640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 1 -- 172.21.15.73:0/2686639020 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3234001d40 con 0x7f3244139450 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f324b5f3640 4 set_mon_vals no callback set 2024-09-11T02:00:52.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f323bfff640 10 monclient: dump: 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.948 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f324b5f3640 10 monclient: shutdown 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f324b5f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.933+0000 7f324b5f3640 1 -- 172.21.15.73:0/2686639020 >> v1:172.21.15.73:6792/0 conn(0x7f3244139450 legacy=0x7f324413df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.934+0000 7f324b5f3640 1 -- 172.21.15.73:0/2686639020 shutdown_connections 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.934+0000 7f324b5f3640 1 -- 172.21.15.73:0/2686639020 >> 172.21.15.73:0/2686639020 conn(0x7f32440a8050 msgr2=0x7f32440a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.934+0000 7f324b5f3640 1 -- 172.21.15.73:0/2686639020 shutdown_connections 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.934+0000 7f324b5f3640 1 -- 172.21.15.73:0/2686639020 wait complete. 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.934+0000 7f324b5f3640 10 monclient: build_initial_monmap 2024-09-11T02:00:52.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.934+0000 7f324b5f3640 10 monclient: monmap: 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:52.950 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.934+0000 7f324b5f3640 1 Processor -- start 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 1 -- start start 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 10 monclient: init 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 10 monclient: _add_conns ranks=[6,3,5,7,1,0,8,2,4] 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 10 monclient(hunting): picked mon.noname-d con 0x7f3244138960 addr v1:172.21.15.73:6792/0 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 10 monclient(hunting): picked mon.noname-g con 0x7f3244139450 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 10 monclient(hunting): picked mon.noname-h con 0x7f324413f620 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324413c9a0 con 0x7f3244139450 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324413ef00 con 0x7f324413f620 2024-09-11T02:00:52.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32440a5090 con 0x7f3244138960 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324b5f3640 10 monclient(hunting): authenticate will time out at 894.539552s 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324938f640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f3244138960 0x7f3244137d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:41078/0 (socket says 172.21.15.73:41078) 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f324938f640 1 -- 172.21.15.73:0/36914769 learned_addr learned my addr 172.21.15.73:0/36914769 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931571770 0 0) 0x7f32440a5090 con 0x7f3244138960 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): my global_id is 114279 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3228003520 con 0x7f3244138960 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543262941 0 0) 0x7f324413c9a0 con 0x7f3244139450 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): my global_id is 5214 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32440a5090 con 0x7f3244139450 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 986510388 0 0) 0x7f3228003520 con 0x7f3244138960 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f324413c9a0 con 0x7f3244138960 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678191144 0 0) 0x7f324413ef00 con 0x7f324413f620 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.935+0000 7f3239ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient(hunting): my global_id is 5270 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3228003520 con 0x7f324413f620 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3240001bb0 con 0x7f3244138960 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:52.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient(hunting): dump: 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.954 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4212827647 0 0) 0x7f324413c9a0 con 0x7f3244138960 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 >> v1:172.21.15.203:6791/0 conn(0x7f324413f620 legacy=0x7f32441d5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 >> v1:172.21.15.203:6790/0 conn(0x7f3244139450 legacy=0x7f32441d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 1 monclient: found mon.d 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324413c6c0 con 0x7f3244138960 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient: _finish_auth 0 2024-09-11T02:00:52.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f324b5f3640 5 monclient: authenticate success, global_id 114279 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f324b5f3640 10 monclient: _renew_subs 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f324b5f3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f324413b1a0 con 0x7f3244138960 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32400038c0 con 0x7f3244138960 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3240003e30 con 0x7f3244138960 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f3239ffb640 10 monclient: dump: 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.956 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.957 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f324b5f3640 10 monclient: _renew_subs 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f323b7fe640 4 set_mon_vals no callback set 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f324b5f3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.936+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f3244138440 con 0x7f3244138960 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f3240003fd0 con 0x7f3244138960 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f324b5f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f324413c100 con 0x7f3244143130 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 221922906 0 0) 0x7f324004e480 con 0x7f3244138960 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3249b90640 10 monclient: get_auth_request con 0x7f322803fe30 auth_method 0 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537884806 0 0) 0x7f324413c100 con 0x7f3244143130 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 10 monclient(hunting): my global_id is 5041 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f324413c9a0 con 0x7f3244143130 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3097982347 0 0) 0x7f324413c9a0 con 0x7f3244143130 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f324413c100 con 0x7f3244143130 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3234001210 con 0x7f3244143130 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 10 monclient: dump: 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.959 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1974255175 0 0) 0x7f324413c100 con 0x7f3244143130 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.937+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f324413f380 con 0x7f3244143130 2024-09-11T02:00:52.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.938+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3234005040 con 0x7f3244143130 2024-09-11T02:00:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.938+0000 7f3239ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.938+0000 7f3239ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.938+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 >> v1:172.21.15.203:6789/0 conn(0x7f3244143130 legacy=0x7f3244063d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.938+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 >> v1:172.21.15.203:6789/0 conn(0x7f3244143130 legacy=0x7f3244063d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f324b5f3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:52.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f32440a07c0 con 0x7f324402e5c0 2024-09-11T02:00:52.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145840641 0 0) 0x7f32440a07c0 con 0x7f324402e5c0 2024-09-11T02:00:52.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 10 monclient(hunting): my global_id is 5050 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f324413c100 con 0x7f324402e5c0 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3627637648 0 0) 0x7f324413c100 con 0x7f324402e5c0 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32440a07c0 con 0x7f324402e5c0 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f32340057e0 con 0x7f324402e5c0 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.944+0000 7f3239ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3239ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3239ffb640 10 monclient: dump: 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:52.963 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:52.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2477247559 0 0) 0x7f32440a07c0 con 0x7f324402e5c0 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 --> v1:172.21.15.203:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f324402e9a0 con 0x7f324402e5c0 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3325120564) 0x7f3234007b10 con 0x7f324402e5c0 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3239ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3239ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 >> v1:172.21.15.203:6789/0 conn(0x7f324402e5c0 legacy=0x7f32440a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3239ffb640 1 -- 172.21.15.73:0/36914769 >> v1:172.21.15.203:6789/0 conn(0x7f324402e5c0 legacy=0x7f32440a00b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:52.965 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 175361, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.966 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.967 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.968 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:52.969 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:52.970 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:52.971 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.972 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.973 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.974 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:52.976 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.977 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.978 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.979 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.980 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:52.981 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:52.982 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:52.983 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:52.984 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:52.985 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:52.985 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 >> v1:172.21.15.203:6812/2311533528 conn(0x7f322803fe30 legacy=0x7f32280422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f324b5f3640 10 monclient: shutdown 2024-09-11T02:00:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f324b5f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:52.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 >> v1:172.21.15.73:6792/0 conn(0x7f3244138960 legacy=0x7f3244137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3249b90640 1 -- 172.21.15.73:0/36914769 reap_dead start 2024-09-11T02:00:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f3249b90640 1 -- 172.21.15.73:0/36914769 reap_dead start 2024-09-11T02:00:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 shutdown_connections 2024-09-11T02:00:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 >> 172.21.15.73:0/36914769 conn(0x7f32440a8050 msgr2=0x7f32440aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 shutdown_connections 2024-09-11T02:00:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:52.945+0000 7f324b5f3640 1 -- 172.21.15.73:0/36914769 wait complete. 2024-09-11T02:00:52.987 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:52.987 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-11T02:00:52.987 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-11T02:00:53.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.084+0000 7f0f31a5a640 10 monclient: get_monmap_and_config 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.084+0000 7f0f31a5a640 10 monclient: build_initial_monmap 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.084+0000 7f0f31a5a640 10 monclient: monmap: 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:53.084896+0000 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:53.084896+0000 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:53.086 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:53.087 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:53.087 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:53.087 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:53.087 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:53.087 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:53.087 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:53.087 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:53.087 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.084+0000 7f0f31a5a640 1 Processor -- start 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.084+0000 7f0f31a5a640 1 -- start start 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.084+0000 7f0f31a5a640 10 monclient: init 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 10 monclient: _add_conns ranks=[2,3,5,4,8,7,1,0,6] 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 10 monclient(hunting): picked mon.noname-b con 0x7f0f2c09ca00 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 10 monclient(hunting): picked mon.noname-g con 0x7f0f2c09d4f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 10 monclient(hunting): picked mon.noname-h con 0x7f0f2c143b70 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2c09e0a0 con 0x7f0f2c09ca00 2024-09-11T02:00:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2c09f4f0 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2c09f7d0 con 0x7f0f2c143b70 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f31a5a640 10 monclient(hunting): authenticate will time out at 894.689415s 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2affd640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f0f2c09ca00 0x7f0f2c09cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:39824/0 (socket says 172.21.15.73:39824) 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2affd640 1 -- 172.21.15.73:0/4091580366 learned_addr learned my addr 172.21.15.73:0/4091580366 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2a7fc640 1 -- 172.21.15.73:0/4091580366 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 460833222 0 0) 0x7f0f2c09e0a0 con 0x7f0f2c09ca00 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2a7fc640 10 monclient(hunting): my global_id is 5231 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2a7fc640 1 -- 172.21.15.73:0/4091580366 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f18003520 con 0x7f0f2c09ca00 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2a7fc640 1 -- 172.21.15.73:0/4091580366 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1688693377 0 0) 0x7f0f18003520 con 0x7f0f2c09ca00 2024-09-11T02:00:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.085+0000 7f0f2a7fc640 1 -- 172.21.15.73:0/4091580366 >> v1:172.21.15.203:6791/0 conn(0x7f0f2c143b70 legacy=0x7f0f2c145f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 1 -- 172.21.15.73:0/4091580366 >> v1:172.21.15.203:6790/0 conn(0x7f0f2c09d4f0 legacy=0x7f0f2c142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 1 monclient: found mon.noname-b 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 1 -- 172.21.15.73:0/4091580366 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2c0a07c0 con 0x7f0f2c09ca00 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: _finish_auth 0 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 5 monclient: authenticate success, global_id 5231 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 1 -- 172.21.15.73:0/4091580366 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f1c001830 con 0x7f0f2c09ca00 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: dump: 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.103 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 1 -- 172.21.15.73:0/4091580366 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f1c001a50 con 0x7f0f2c09ca00 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 1 -- 172.21.15.73:0/4091580366 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f1c004be0 con 0x7f0f2c09ca00 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 4 set_mon_vals no callback set 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f2a7fc640 10 monclient: dump: 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.106 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 10 monclient: shutdown 2024-09-11T02:00:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 1 -- 172.21.15.73:0/4091580366 >> v1:172.21.15.73:6790/0 conn(0x7f0f2c09ca00 legacy=0x7f0f2c09cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 1 -- 172.21.15.73:0/4091580366 shutdown_connections 2024-09-11T02:00:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 1 -- 172.21.15.73:0/4091580366 >> 172.21.15.73:0/4091580366 conn(0x7f0f2c0a8050 msgr2=0x7f0f2c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 1 -- 172.21.15.73:0/4091580366 shutdown_connections 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.086+0000 7f0f31a5a640 1 -- 172.21.15.73:0/4091580366 wait complete. 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.087+0000 7f0f31a5a640 10 monclient: build_initial_monmap 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.087+0000 7f0f31a5a640 10 monclient: monmap: 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.087+0000 7f0f31a5a640 1 Processor -- start 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.087+0000 7f0f31a5a640 1 -- start start 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.087+0000 7f0f31a5a640 10 monclient: init 2024-09-11T02:00:53.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 10 monclient: _add_conns ranks=[5,0,7,1,6,3,4,2,8] 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 10 monclient(hunting): picked mon.noname-h con 0x7f0f2c09ca00 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 10 monclient(hunting): picked mon.noname-a con 0x7f0f2c09d4f0 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 10 monclient(hunting): picked mon.noname-i con 0x7f0f2c143b70 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2c141590 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2c13f040 con 0x7f0f2c09ca00 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2c0a8430 con 0x7f0f2c143b70 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 10 monclient(hunting): authenticate will time out at 894.692172s 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f23fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0f2c09d4f0 0x7f0f2c13e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47136/0 (socket says 172.21.15.73:47136) 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f23fff640 1 -- 172.21.15.73:0/3540377667 learned_addr learned my addr 172.21.15.73:0/3540377667 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2609340384 0 0) 0x7f0f2c141590 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): my global_id is 5355 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f0c003520 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016605141 0 0) 0x7f0f2c13f040 con 0x7f0f2c09ca00 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): my global_id is 5288 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f2c141590 con 0x7f0f2c09ca00 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265680909 0 0) 0x7f0f2c0a8430 con 0x7f0f2c143b70 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): my global_id is 5101 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f2c13f040 con 0x7f0f2c143b70 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1744836724 0 0) 0x7f0f0c003520 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f2c0a8430 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f14001b70 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): dump: 2024-09-11T02:00:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1684003931 0 0) 0x7f0f2c141590 con 0x7f0f2c09ca00 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f0c003520 con 0x7f0f2c09ca00 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f1c001c00 con 0x7f0f2c09ca00 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): dump: 2024-09-11T02:00:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 490006773 0 0) 0x7f0f2c13f040 con 0x7f0f2c143b70 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f2c141590 con 0x7f0f2c143b70 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f24001d50 con 0x7f0f2c143b70 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient(hunting): dump: 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1349554417 0 0) 0x7f0f2c0a8430 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 >> v1:172.21.15.203:6792/0 conn(0x7f0f2c143b70 legacy=0x7f0f2c1d9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 >> v1:172.21.15.203:6791/0 conn(0x7f0f2c09ca00 legacy=0x7f0f2c13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:00:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 monclient: found mon.a 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2c143510 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient: _finish_auth 0 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f28ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 5 monclient: authenticate success, global_id 5355 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 10 monclient: _renew_subs 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.088+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2c1412b0 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f31a5a640 10 monclient: _renew_subs 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f31a5a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f2c143010 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f140038c0 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f28ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f14003df0 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f29ffb640 4 set_mon_vals no callback set 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f28ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f28ff9640 10 monclient: dump: 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.118 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f31a5a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f100065c0 con 0x7f0f10002860 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.089+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f0f14003f90 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 221922906 0 0) 0x7f0f1404e540 con 0x7f0f2c09d4f0 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310769995 0 0) 0x7f0f100065c0 con 0x7f0f10002860 2024-09-11T02:00:53.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 10 monclient(hunting): my global_id is 5232 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f2c0a8430 con 0x7f0f10002860 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f2b7fe640 10 monclient: get_auth_request con 0x7f0f0c040780 auth_method 0 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2899563934 0 0) 0x7f0f2c0a8430 con 0x7f0f10002860 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f100065c0 con 0x7f0f10002860 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f1c004b20 con 0x7f0f10002860 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 10 monclient: dump: 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.120 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.121 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3480534582 0 0) 0x7f0f100065c0 con 0x7f0f10002860 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.090+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f1000a160 con 0x7f0f10002860 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.091+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0f1c005fe0 con 0x7f0f10002860 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.091+0000 7f0f28ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.091+0000 7f0f28ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.091+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 >> v1:172.21.15.203:6790/0 conn(0x7f0f10002860 legacy=0x7f0f10004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.091+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 >> v1:172.21.15.203:6790/0 conn(0x7f0f10002860 legacy=0x7f0f10004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f31a5a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f10009e70 con 0x7f0f10009130 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928816434 0 0) 0x7f0f10009e70 con 0x7f0f10009130 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 10 monclient(hunting): my global_id is 5241 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f100065c0 con 0x7f0f10009130 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 587388521 0 0) 0x7f0f100065c0 con 0x7f0f10009130 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f10009e70 con 0x7f0f10009130 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0f1c006800 con 0x7f0f10009130 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 10 monclient: dump: 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3279739467 0 0) 0x7f0f10009e70 con 0x7f0f10009130 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.097+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 --> v1:172.21.15.203:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f1000c410 con 0x7f0f10009130 2024-09-11T02:00:53.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 3179799241) 0x7f0f1c006930 con 0x7f0f10009130 2024-09-11T02:00:53.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f28ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:53.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f28ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:53.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 >> v1:172.21.15.203:6790/0 conn(0x7f0f10009130 legacy=0x7f0f100095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f28ff9640 1 -- 172.21.15.73:0/3540377667 >> v1:172.21.15.203:6790/0 conn(0x7f0f10009130 legacy=0x7f0f100095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:53.125 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:53.125 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:53.125 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:53.125 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 175535, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:53.126 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:53.127 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:53.128 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:53.129 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:53.130 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:53.131 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.132 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:53.133 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.134 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:53.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.138 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.139 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:53.139 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:53.139 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.139 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.140 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.140 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:53.140 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.140 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.140 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.140 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:53.140 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:53.141 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.141 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.141 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.141 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:53.141 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:53.141 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.141 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:53.143 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.144 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:53.145 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:53.146 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-09-11T02:00:53.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.147 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.147 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.147 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:53.147 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 >> v1:172.21.15.203:6812/2311533528 conn(0x7f0f0c040780 legacy=0x7f0f0c042c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f31a5a640 10 monclient: shutdown 2024-09-11T02:00:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f31a5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 >> v1:172.21.15.73:6789/0 conn(0x7f0f2c09d4f0 legacy=0x7f0f2c13e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f2b7fe640 1 -- 172.21.15.73:0/3540377667 reap_dead start 2024-09-11T02:00:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f2b7fe640 1 -- 172.21.15.73:0/3540377667 reap_dead start 2024-09-11T02:00:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 shutdown_connections 2024-09-11T02:00:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 >> 172.21.15.73:0/3540377667 conn(0x7f0f2c0a8050 msgr2=0x7f0f2c0a9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 shutdown_connections 2024-09-11T02:00:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.098+0000 7f0f31a5a640 1 -- 172.21.15.73:0/3540377667 wait complete. 2024-09-11T02:00:53.149 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:53.150 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-11T02:00:53.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-11T02:00:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.245+0000 7f46e0d6b640 10 monclient: get_monmap_and_config 2024-09-11T02:00:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.245+0000 7f46e0d6b640 10 monclient: build_initial_monmap 2024-09-11T02:00:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.245+0000 7f46e0d6b640 10 monclient: monmap: 2024-09-11T02:00:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:53.246697+0000 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:53.246697+0000 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:53.249 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.246+0000 7f46e0d6b640 1 Processor -- start 2024-09-11T02:00:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.246+0000 7f46e0d6b640 1 -- start start 2024-09-11T02:00:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.246+0000 7f46e0d6b640 10 monclient: init 2024-09-11T02:00:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 10 monclient: _add_conns ranks=[0,3,7,4,8,6,1,5,2] 2024-09-11T02:00:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 10 monclient(hunting): picked mon.noname-a con 0x7f46dc138d40 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 10 monclient(hunting): picked mon.noname-g con 0x7f46dc0a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 10 monclient(hunting): picked mon.noname-i con 0x7f46dc13f350 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:53.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46dc09ca00 con 0x7f46dc138d40 2024-09-11T02:00:53.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46dc0a7070 con 0x7f46dc0a72f0 2024-09-11T02:00:53.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46dc09cee0 con 0x7f46dc13f350 2024-09-11T02:00:53.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:53.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 10 monclient(hunting): authenticate will time out at 894.851178s 2024-09-11T02:00:53.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46da59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f46dc138d40 0x7f46dc139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47152/0 (socket says 172.21.15.73:47152) 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46da59c640 1 -- 172.21.15.73:0/3583744093 learned_addr learned my addr 172.21.15.73:0/3583744093 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 721883401 0 0) 0x7f46dc09ca00 con 0x7f46dc138d40 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): my global_id is 5364 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46c4003520 con 0x7f46dc138d40 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076807145 0 0) 0x7f46dc09cee0 con 0x7f46dc13f350 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): my global_id is 5110 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46dc09ca00 con 0x7f46dc13f350 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3042808575 0 0) 0x7f46dc0a7070 con 0x7f46dc0a72f0 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient(hunting): my global_id is 5250 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46dc09cee0 con 0x7f46dc0a72f0 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2135552774 0 0) 0x7f46c4003520 con 0x7f46dc138d40 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 >> v1:172.21.15.203:6792/0 conn(0x7f46dc13f350 legacy=0x7f46dc141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 >> v1:172.21.15.203:6790/0 conn(0x7f46dc0a72f0 legacy=0x7f46dc13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: _finish_hunting 0 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 monclient: found mon.noname-a 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc09d1c0 con 0x7f46dc138d40 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: _finish_auth 0 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: _check_auth_tickets 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f46cc001850 con 0x7f46dc138d40 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 5 monclient: authenticate success, global_id 5364 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: dump: 2024-09-11T02:00:53.263 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.264 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46cc001a70 con 0x7f46dc138d40 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 1 -- 172.21.15.73:0/3583744093 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f46cc004be0 con 0x7f46dc138d40 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46e0d6b640 4 set_mon_vals no callback set 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.247+0000 7f46d959a640 10 monclient: dump: 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.265 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.248+0000 7f46e0d6b640 10 monclient: shutdown 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.248+0000 7f46e0d6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.248+0000 7f46e0d6b640 1 -- 172.21.15.73:0/3583744093 >> v1:172.21.15.73:6789/0 conn(0x7f46dc138d40 legacy=0x7f46dc139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.248+0000 7f46e0d6b640 1 -- 172.21.15.73:0/3583744093 shutdown_connections 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.248+0000 7f46e0d6b640 1 -- 172.21.15.73:0/3583744093 >> 172.21.15.73:0/3583744093 conn(0x7f46dc0a8050 msgr2=0x7f46dc0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.248+0000 7f46e0d6b640 1 -- 172.21.15.73:0/3583744093 shutdown_connections 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.248+0000 7f46e0d6b640 1 -- 172.21.15.73:0/3583744093 wait complete. 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 10 monclient: build_initial_monmap 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 10 monclient: monmap: 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:53.267 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 1 Processor -- start 2024-09-11T02:00:53.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 1 -- start start 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 10 monclient: init 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 10 monclient: _add_conns ranks=[3,5,7,1,0,2,4,6,8] 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 10 monclient(hunting): picked mon.noname-g con 0x7f46dc0a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 10 monclient(hunting): picked mon.noname-h con 0x7f46dc138d40 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 10 monclient(hunting): picked mon.noname-i con 0x7f46dc13f350 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46dc13e5d0 con 0x7f46dc0a72f0 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46dc139a20 con 0x7f46dc138d40 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.249+0000 7f46e0d6b640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46dc09fa60 con 0x7f46dc13f350 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46e0d6b640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46e0d6b640 10 monclient(hunting): authenticate will time out at 894.854012s 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46da59c640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7f46dc0a72f0 0x7f46dc09ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.73:47130/0 (socket says 172.21.15.73:47130) 2024-09-11T02:00:53.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46da59c640 1 -- 172.21.15.73:0/1694356355 learned_addr learned my addr 172.21.15.73:0/1694356355 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379348357 0 0) 0x7f46dc13e5d0 con 0x7f46dc0a72f0 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): my global_id is 5259 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46bc003550 con 0x7f46dc0a72f0 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 306361506 0 0) 0x7f46dc09cee0 con 0x7f46dc138d40 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): my global_id is 5297 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46dc13e5d0 con 0x7f46dc138d40 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934811125 0 0) 0x7f46dc09fa60 con 0x7f46dc13f350 2024-09-11T02:00:53.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): my global_id is 5119 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46dc09cee0 con 0x7f46dc13f350 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3615231424 0 0) 0x7f46bc003550 con 0x7f46dc0a72f0 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46dc09fa60 con 0x7f46dc0a72f0 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1014244613 0 0) 0x7f46dc13e5d0 con 0x7f46dc138d40 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46bc003550 con 0x7f46dc138d40 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f46cc004b20 con 0x7f46dc0a72f0 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): dump: 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.271 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.272 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f46d00019c0 con 0x7f46dc138d40 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): dump: 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.273 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3817739514 0 0) 0x7f46dc09cee0 con 0x7f46dc13f350 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46dc13e5d0 con 0x7f46dc13f350 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f46d4001b90 con 0x7f46dc13f350 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient(hunting): dump: 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.275 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3672330049 0 0) 0x7f46dc09fa60 con 0x7f46dc0a72f0 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 >> v1:172.21.15.203:6792/0 conn(0x7f46dc13f350 legacy=0x7f46dc1d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 >> v1:172.21.15.203:6791/0 conn(0x7f46dc138d40 legacy=0x7f46dc09f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient: _finish_hunting 0 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 monclient: found mon.g 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46dc1420f0 con 0x7f46dc0a72f0 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient: _finish_auth 0 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient: _check_auth_tickets 2024-09-11T02:00:53.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46e0d6b640 5 monclient: authenticate success, global_id 5259 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46e0d6b640 10 monclient: _renew_subs 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46e0d6b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46dc0a15f0 con 0x7f46dc0a72f0 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46e0d6b640 10 monclient: _renew_subs 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46e0d6b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.203:6790/0 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f46dc0a0970 con 0x7f46dc0a72f0 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.3 v1:172.21.15.203:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46cc001990 con 0x7f46dc0a72f0 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.3 v1:172.21.15.203:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f46cc0051e0 con 0x7f46dc0a72f0 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.251+0000 7f46caffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:00:53.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.250+0000 7f46d8d99640 4 set_mon_vals no callback set 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.251+0000 7f46caffd640 10 monclient: dump: 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.278 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.251+0000 7f46e0d6b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.251+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f46c00065c0 con 0x7f46c0002860 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.251+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.3 v1:172.21.15.203:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f46cc011920 con 0x7f46dc0a72f0 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.3 v1:172.21.15.203:6790/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 221922906 0 0) 0x7f46cc04e620 con 0x7f46dc0a72f0 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043055975 0 0) 0x7f46c00065c0 con 0x7f46c0002860 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 10 monclient(hunting): my global_id is 5306 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46dc09fa60 con 0x7f46c0002860 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46dad9d640 10 monclient: get_auth_request con 0x7f46bc040720 auth_method 0 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 454287063 0 0) 0x7f46dc09fa60 con 0x7f46c0002860 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46c00065c0 con 0x7f46c0002860 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f46d0003950 con 0x7f46c0002860 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 10 monclient: dump: 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.280 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.281 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2510820103 0 0) 0x7f46c00065c0 con 0x7f46c0002860 2024-09-11T02:00:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.252+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46c000a160 con 0x7f46c0002860 2024-09-11T02:00:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.253+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f46d0003cf0 con 0x7f46c0002860 2024-09-11T02:00:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.253+0000 7f46caffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.253+0000 7f46caffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.253+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 >> v1:172.21.15.203:6791/0 conn(0x7f46c0002860 legacy=0x7f46c0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.253+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 >> v1:172.21.15.203:6791/0 conn(0x7f46c0002860 legacy=0x7f46c0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46e0d6b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f46c0009e00 con 0x7f46c00090e0 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012902959 0 0) 0x7f46c0009e00 con 0x7f46c00090e0 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 10 monclient(hunting): my global_id is 5315 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46c00065c0 con 0x7f46c00090e0 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2146451777 0 0) 0x7f46c00065c0 con 0x7f46c00090e0 2024-09-11T02:00:53.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46c0009e00 con 0x7f46c00090e0 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f46d00044d0 con 0x7f46c00090e0 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 10 monclient: dump: 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.285 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 588164113 0 0) 0x7f46c0009e00 con 0x7f46c00090e0 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.259+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 --> v1:172.21.15.203:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f46c000c3a0 con 0x7f46c00090e0 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 79071079) 0x7f46d0005900 con 0x7f46c00090e0 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46caffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46caffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 >> v1:172.21.15.203:6791/0 conn(0x7f46c00090e0 legacy=0x7f46c0009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46caffd640 1 -- 172.21.15.73:0/1694356355 >> v1:172.21.15.203:6791/0 conn(0x7f46c00090e0 legacy=0x7f46c0009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:53.287 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 175696, 2024-09-11T02:00:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:53.287 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:53.288 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.291 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:53.291 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:53.291 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:53.291 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:53.291 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:53.291 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:53.291 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:53.291 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:53.291 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:53.292 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:53.292 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:53.292 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:53.292 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:53.293 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.295 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.296 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.297 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.299 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.301 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.303 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.304 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.305 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.306 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:53.307 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:53.308 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 >> v1:172.21.15.203:6812/2311533528 conn(0x7f46bc040720 legacy=0x7f46bc042be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46e0d6b640 10 monclient: shutdown 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46e0d6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 >> v1:172.21.15.203:6790/0 conn(0x7f46dc0a72f0 legacy=0x7f46dc09ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46dad9d640 1 -- 172.21.15.73:0/1694356355 reap_dead start 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46dad9d640 1 -- 172.21.15.73:0/1694356355 reap_dead start 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 shutdown_connections 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 >> 172.21.15.73:0/1694356355 conn(0x7f46dc0a8050 msgr2=0x7f46dc131c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 shutdown_connections 2024-09-11T02:00:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.260+0000 7f46e0d6b640 1 -- 172.21.15.73:0/1694356355 wait complete. 2024-09-11T02:00:53.311 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:53.311 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-11T02:00:53.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-11T02:00:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.408+0000 7f9a4a194640 10 monclient: get_monmap_and_config 2024-09-11T02:00:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.408+0000 7f9a4a194640 10 monclient: build_initial_monmap 2024-09-11T02:00:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.408+0000 7f9a4a194640 10 monclient: monmap: 2024-09-11T02:00:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.410 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:53.409517+0000 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:53.409517+0000 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:53.411 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.409+0000 7f9a4a194640 1 Processor -- start 2024-09-11T02:00:53.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.409+0000 7f9a4a194640 1 -- start start 2024-09-11T02:00:53.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.409+0000 7f9a4a194640 10 monclient: init 2024-09-11T02:00:53.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.409+0000 7f9a4a194640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:53.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.409+0000 7f9a4a194640 10 monclient: _add_conns ranks=[7,8,4,3,0,5,1,6,2] 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.409+0000 7f9a4a194640 10 monclient(hunting): picked mon.noname-i con 0x7f9a440a5b30 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 10 monclient(hunting): picked mon.noname-e con 0x7f9a440a6620 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 10 monclient(hunting): picked mon.noname-c con 0x7f9a4409db70 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a440a7490 con 0x7f9a4409db70 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4409ca00 con 0x7f9a440a5b30 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4406fbf0 con 0x7f9a440a6620 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 10 monclient(hunting): authenticate will time out at 895.014089s 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a42ffd640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f9a440a6620 0x7f9a4413dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53644/0 (socket says 172.21.15.73:53644) 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a43fff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f9a4409db70 0x7f9a44141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40388/0 (socket says 172.21.15.73:40388) 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a42ffd640 1 -- 172.21.15.73:0/30278785 learned_addr learned my addr 172.21.15.73:0/30278785 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1629197923 0 0) 0x7f9a4406fbf0 con 0x7f9a440a6620 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): my global_id is 114290 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a2c003520 con 0x7f9a440a6620 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190393068 0 0) 0x7f9a440a7490 con 0x7f9a4409db70 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): my global_id is 5116 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a4406fbf0 con 0x7f9a4409db70 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851929209 0 0) 0x7f9a4409ca00 con 0x7f9a440a5b30 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient(hunting): my global_id is 5128 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a440a7490 con 0x7f9a440a5b30 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 937230184 0 0) 0x7f9a4406fbf0 con 0x7f9a4409db70 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 >> v1:172.21.15.73:6793/0 conn(0x7f9a440a6620 legacy=0x7f9a4413dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 >> v1:172.21.15.203:6792/0 conn(0x7f9a440a5b30 legacy=0x7f9a440a5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: _finish_hunting 0 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 monclient: found mon.noname-c 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4409ceb0 con 0x7f9a4409db70 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: _finish_auth 0 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: _check_auth_tickets 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:53.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a3c0016c0 con 0x7f9a4409db70 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 5 monclient: authenticate success, global_id 5116 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: dump: 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.425 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a3c001860 con 0x7f9a4409db70 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 1 -- 172.21.15.73:0/30278785 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a3c0047e0 con 0x7f9a4409db70 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a4a194640 4 set_mon_vals no callback set 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.410+0000 7f9a427fc640 10 monclient: dump: 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.427 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.411+0000 7f9a4a194640 10 monclient: shutdown 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.411+0000 7f9a4a194640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.411+0000 7f9a4a194640 1 -- 172.21.15.73:0/30278785 >> v1:172.21.15.73:6791/0 conn(0x7f9a4409db70 legacy=0x7f9a44141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.411+0000 7f9a4a194640 1 -- 172.21.15.73:0/30278785 shutdown_connections 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.411+0000 7f9a4a194640 1 -- 172.21.15.73:0/30278785 >> 172.21.15.73:0/30278785 conn(0x7f9a440abe30 msgr2=0x7f9a440a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.411+0000 7f9a4a194640 1 -- 172.21.15.73:0/30278785 shutdown_connections 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.411+0000 7f9a4a194640 1 -- 172.21.15.73:0/30278785 wait complete. 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.411+0000 7f9a4a194640 10 monclient: build_initial_monmap 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.411+0000 7f9a4a194640 10 monclient: monmap: 2024-09-11T02:00:53.428 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:53.429 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 1 Processor -- start 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 1 -- start start 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 10 monclient: init 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 10 monclient: _add_conns ranks=[8,5,2,0,6,1,7,3,4] 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 10 monclient(hunting): picked mon.noname-e con 0x7f9a440a5b30 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 10 monclient(hunting): picked mon.noname-h con 0x7f9a440a6620 addr v1:172.21.15.203:6791/0 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 10 monclient(hunting): picked mon.noname-b con 0x7f9a44127690 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a44128020 con 0x7f9a44127690 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a44126b30 con 0x7f9a440a6620 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a44128e90 con 0x7f9a440a5b30 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a4a194640 10 monclient(hunting): authenticate will time out at 895.016849s 2024-09-11T02:00:53.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a437fe640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f9a440a5b30 0x7f9a44141430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53658/0 (socket says 172.21.15.73:53658) 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.412+0000 7f9a437fe640 1 -- 172.21.15.73:0/585683111 learned_addr learned my addr 172.21.15.73:0/585683111 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94394661 0 0) 0x7f9a44128e90 con 0x7f9a440a5b30 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): my global_id is 114299 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a30003550 con 0x7f9a440a5b30 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668312239 0 0) 0x7f9a44128020 con 0x7f9a44127690 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): my global_id is 5240 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a44128e90 con 0x7f9a44127690 2024-09-11T02:00:53.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1335276266 0 0) 0x7f9a44126b30 con 0x7f9a440a6620 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): my global_id is 5324 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a44128020 con 0x7f9a440a6620 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2942027284 0 0) 0x7f9a30003550 con 0x7f9a440a5b30 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a44126b30 con 0x7f9a440a5b30 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a34001f30 con 0x7f9a440a5b30 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): dump: 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.432 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2605836294 0 0) 0x7f9a44128e90 con 0x7f9a44127690 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a30003550 con 0x7f9a44127690 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a3c001600 con 0x7f9a44127690 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): dump: 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.434 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1708528984 0 0) 0x7f9a44128020 con 0x7f9a440a6620 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a44128e90 con 0x7f9a440a6620 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a38001880 con 0x7f9a440a6620 2024-09-11T02:00:53.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient(hunting): dump: 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.436 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3201147415 0 0) 0x7f9a44126b30 con 0x7f9a440a5b30 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 >> v1:172.21.15.203:6791/0 conn(0x7f9a440a6620 legacy=0x7f9a441d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 >> v1:172.21.15.73:6790/0 conn(0x7f9a44127690 legacy=0x7f9a441d5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient: _finish_hunting 0 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 monclient: found mon.e 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a441285f0 con 0x7f9a440a5b30 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient: _finish_auth 0 2024-09-11T02:00:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient: _check_auth_tickets 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a4a194640 5 monclient: authenticate success, global_id 114299 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a4a194640 10 monclient: _renew_subs 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a4a194640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a44141b40 con 0x7f9a440a5b30 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a4a194640 10 monclient: _renew_subs 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a4a194640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a441cd820 con 0x7f9a440a5b30 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a34003c40 con 0x7f9a440a5b30 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a34004270 con 0x7f9a440a5b30 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a41ffb640 4 set_mon_vals no callback set 2024-09-11T02:00:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.413+0000 7f9a2bfff640 10 monclient: dump: 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.414+0000 7f9a4a194640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.414+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9a240065c0 con 0x7f9a24002860 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.414+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9a34004410 con 0x7f9a440a5b30 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.414+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 221922906 0 0) 0x7f9a3404e850 con 0x7f9a440a5b30 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386940379 0 0) 0x7f9a240065c0 con 0x7f9a24002860 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 10 monclient(hunting): my global_id is 5137 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a44126b30 con 0x7f9a24002860 2024-09-11T02:00:53.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a43fff640 10 monclient: get_auth_request con 0x7f9a30040750 auth_method 0 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1283138298 0 0) 0x7f9a44126b30 con 0x7f9a24002860 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a240065c0 con 0x7f9a24002860 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a38004b20 con 0x7f9a24002860 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 10 monclient: dump: 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.441 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1730193158 0 0) 0x7f9a240065c0 con 0x7f9a24002860 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a2400a160 con 0x7f9a24002860 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9a38007480 con 0x7f9a24002860 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:53.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 >> v1:172.21.15.203:6792/0 conn(0x7f9a24002860 legacy=0x7f9a24004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.415+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 >> v1:172.21.15.203:6792/0 conn(0x7f9a24002860 legacy=0x7f9a24004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a4a194640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:00:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9a24009e20 con 0x7f9a240090e0 2024-09-11T02:00:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261418270 0 0) 0x7f9a24009e20 con 0x7f9a240090e0 2024-09-11T02:00:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 10 monclient(hunting): my global_id is 5146 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a240065c0 con 0x7f9a240090e0 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3196986225 0 0) 0x7f9a240065c0 con 0x7f9a240090e0 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a24009e20 con 0x7f9a240090e0 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a38005670 con 0x7f9a240090e0 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 10 monclient: dump: 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.445 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1886840537 0 0) 0x7f9a24009e20 con 0x7f9a240090e0 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.422+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 --> v1:172.21.15.203:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9a2400c3f0 con 0x7f9a240090e0 2024-09-11T02:00:53.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3458318837) 0x7f9a38006ac0 con 0x7f9a240090e0 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a2bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a2bfff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 >> v1:172.21.15.203:6792/0 conn(0x7f9a240090e0 legacy=0x7f9a24009570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a2bfff640 1 -- 172.21.15.73:0/585683111 >> v1:172.21.15.203:6792/0 conn(0x7f9a240090e0 legacy=0x7f9a24009570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 32, 2024-09-11T02:00:53.447 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 175843, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 5, 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:53.448 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.449 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.450 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:00:53.451 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:00:53.452 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.453 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.454 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:00:53.455 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.456 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.457 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:00:53.458 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.460 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.461 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.462 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:00:53.463 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:00:53.465 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:00:53.466 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:00:53.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:00:53.466 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:00:53.466 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:00:53.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9a30040750 legacy=0x7f9a30042c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a4a194640 10 monclient: shutdown 2024-09-11T02:00:53.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a4a194640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:53.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 >> v1:172.21.15.73:6793/0 conn(0x7f9a440a5b30 legacy=0x7f9a44141430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a43fff640 1 -- 172.21.15.73:0/585683111 reap_dead start 2024-09-11T02:00:53.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a43fff640 1 -- 172.21.15.73:0/585683111 reap_dead start 2024-09-11T02:00:53.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 shutdown_connections 2024-09-11T02:00:53.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.423+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 >> 172.21.15.73:0/585683111 conn(0x7f9a4409db70 msgr2=0x7f9a44142040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:53.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.424+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 shutdown_connections 2024-09-11T02:00:53.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.424+0000 7f9a4a194640 1 -- 172.21.15.73:0/585683111 wait complete. 2024-09-11T02:00:53.468 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:00:53.468 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-11T02:00:53.469 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T02:00:53.469 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-11T02:00:53.469 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-11T02:00:53.469 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T02:00:53.469 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:00:53.481 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T02:00:53.481 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-09-11T02:00:53.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:00:53.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.617+0000 7fc77c62b640 10 monclient: get_monmap_and_config 2024-09-11T02:00:53.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.617+0000 7fc77c62b640 10 monclient: build_initial_monmap 2024-09-11T02:00:53.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.617+0000 7fc77c62b640 10 monclient: monmap: 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:53.617896+0000 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:53.617896+0000 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:53.619 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:53.620 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:53.620 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.617+0000 7fc77c62b640 1 Processor -- start 2024-09-11T02:00:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.617+0000 7fc77c62b640 1 -- start start 2024-09-11T02:00:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.617+0000 7fc77c62b640 10 monclient: init 2024-09-11T02:00:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 10 monclient: _add_conns ranks=[4,8,3,2,7,1,0,5,6] 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 10 monclient(hunting): picked mon.noname-c con 0x7fc774138960 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 10 monclient(hunting): picked mon.noname-e con 0x7fc774139450 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 10 monclient(hunting): picked mon.noname-g con 0x7fc77413f620 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77409d030 con 0x7fc77413f620 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77409d310 con 0x7fc774138960 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77406f770 con 0x7fc774139450 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77c62b640 10 monclient(hunting): authenticate will time out at 895.222473s 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77a3c7640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fc774138960 0x7fc774138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40394/0 (socket says 172.21.15.73:40394) 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc77a3c7640 1 -- 172.21.15.73:0/4074147771 learned_addr learned my addr 172.21.15.73:0/4074147771 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 138258275 0 0) 0x7fc77409d310 con 0x7fc774138960 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): my global_id is 5125 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc75c003520 con 0x7fc774138960 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002928983 0 0) 0x7fc77406f770 con 0x7fc774139450 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): my global_id is 114308 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc77409d310 con 0x7fc774139450 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279301381 0 0) 0x7fc77409d030 con 0x7fc77413f620 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 10 monclient(hunting): my global_id is 5268 2024-09-11T02:00:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc77406f770 con 0x7fc77413f620 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.618+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 804301968 0 0) 0x7fc75c003520 con 0x7fc774138960 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 >> v1:172.21.15.73:6793/0 conn(0x7fc774139450 legacy=0x7fc77413df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 >> v1:172.21.15.203:6790/0 conn(0x7fc77413f620 legacy=0x7fc774141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: _finish_hunting 0 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 1 monclient: found mon.noname-c 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7740a7360 con 0x7fc774138960 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: _finish_auth 0 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: _check_auth_tickets 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc764001bb0 con 0x7fc774138960 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 5 monclient: authenticate success, global_id 5125 2024-09-11T02:00:53.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: dump: 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.631 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc764001d50 con 0x7fc774138960 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 1 -- 172.21.15.73:0/4074147771 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc764004f60 con 0x7fc774138960 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 4 set_mon_vals no callback set 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc7793c5640 10 monclient: dump: 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 10 monclient: shutdown 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 1 -- 172.21.15.73:0/4074147771 >> v1:172.21.15.73:6791/0 conn(0x7fc774138960 legacy=0x7fc774138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 1 -- 172.21.15.73:0/4074147771 shutdown_connections 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 1 -- 172.21.15.73:0/4074147771 >> 172.21.15.73:0/4074147771 conn(0x7fc7740a8050 msgr2=0x7fc7740a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 1 -- 172.21.15.73:0/4074147771 shutdown_connections 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.619+0000 7fc77c62b640 1 -- 172.21.15.73:0/4074147771 wait complete. 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.620+0000 7fc77c62b640 10 monclient: build_initial_monmap 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.620+0000 7fc77c62b640 10 monclient: monmap: 2024-09-11T02:00:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.620+0000 7fc77c62b640 1 Processor -- start 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.620+0000 7fc77c62b640 1 -- start start 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.620+0000 7fc77c62b640 10 monclient: init 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.620+0000 7fc77c62b640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient: _add_conns ranks=[8,4,1,0,2,6,3,7,5] 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient(hunting): picked mon.noname-e con 0x7fc774138960 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient(hunting): picked mon.noname-c con 0x7fc774139450 addr v1:172.21.15.73:6791/0 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient(hunting): picked mon.noname-f con 0x7fc77413f620 addr v1:172.21.15.203:6789/0 2024-09-11T02:00:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77406ead0 con 0x7fc77413f620 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77406e680 con 0x7fc774139450 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77413adc0 con 0x7fc774138960 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient(hunting): authenticate will time out at 895.225087s 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc779bc6640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fc774139450 0x7fc7741d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40402/0 (socket says 172.21.15.73:40402) 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77a3c7640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fc774138960 0x7fc77413e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53682/0 (socket says 172.21.15.73:53682) 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc779bc6640 1 -- 172.21.15.73:0/283014450 learned_addr learned my addr 172.21.15.73:0/283014450 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181322686 0 0) 0x7fc77406e680 con 0x7fc774139450 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): my global_id is 5134 2024-09-11T02:00:53.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc760003520 con 0x7fc774139450 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3449966216 0 0) 0x7fc77413adc0 con 0x7fc774138960 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): my global_id is 114317 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc77406e680 con 0x7fc774138960 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911537613 0 0) 0x7fc77406ead0 con 0x7fc77413f620 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): my global_id is 5059 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc77413adc0 con 0x7fc77413f620 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2578599637 0 0) 0x7fc760003520 con 0x7fc774139450 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc77406ead0 con 0x7fc774139450 2024-09-11T02:00:53.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc768001bd0 con 0x7fc774139450 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): dump: 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3410990676 0 0) 0x7fc77406e680 con 0x7fc774138960 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc760003520 con 0x7fc774138960 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc764001af0 con 0x7fc774138960 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): dump: 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2420478049 0 0) 0x7fc77413adc0 con 0x7fc77413f620 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc77406e680 con 0x7fc77413f620 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc76c0019f0 con 0x7fc77413f620 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient(hunting): dump: 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 814882398 0 0) 0x7fc77406ead0 con 0x7fc774139450 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 >> v1:172.21.15.73:6793/0 conn(0x7fc774138960 legacy=0x7fc77413e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 >> v1:172.21.15.203:6789/0 conn(0x7fc77413f620 legacy=0x7fc7741d6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 monclient: found mon.c 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77413bbd0 con 0x7fc774139450 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient: _finish_auth 0 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 5 monclient: authenticate success, global_id 5134 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient: _renew_subs 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc77413d120 con 0x7fc774139450 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient: _renew_subs 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc77413ed60 con 0x7fc774139450 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7680038c0 con 0x7fc774139450 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.621+0000 7fc772ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc768003e70 con 0x7fc774139450 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc772ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc772ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc772ffd640 10 monclient: dump: 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc778bc4640 4 set_mon_vals no callback set 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fc768004090 con 0x7fc774139450 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc77c62b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc77c62b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc77c62b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 221922906 0 0) 0x7fc76804e430 con 0x7fc774139450 2024-09-11T02:00:53.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.622+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7740a88c0 con 0x7fc774139450 2024-09-11T02:00:53.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.623+0000 7fc77a3c7640 10 monclient: get_auth_request con 0x7fc760040710 auth_method 0 2024-09-11T02:00:53.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.627+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fc7740a88c0 con 0x7fc774139450 2024-09-11T02:00:53.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.627+0000 7fc772ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:53.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.627+0000 7fc772ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:53.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.871+0000 7fc77c62b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:00:53.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.871+0000 7fc77c62b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:00:53.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.871+0000 7fc77c62b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:00:53.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.871+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc774138ff0 con 0x7fc774139450 2024-09-11T02:00:53.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.871+0000 7fc772ffd640 1 -- 172.21.15.73:0/283014450 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 3691307937) 0x7fc774138ff0 con 0x7fc774139450 2024-09-11T02:00:53.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.871+0000 7fc772ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:00:53.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.871+0000 7fc772ffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:53.874 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":32,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:00:53.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.873+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 >> v1:172.21.15.203:6812/2311533528 conn(0x7fc760040710 legacy=0x7fc760042bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.874+0000 7fc77c62b640 10 monclient: shutdown 2024-09-11T02:00:53.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.874+0000 7fc77c62b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:53.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.874+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 >> v1:172.21.15.73:6791/0 conn(0x7fc774139450 legacy=0x7fc7741d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:53.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.874+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 shutdown_connections 2024-09-11T02:00:53.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.874+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 >> 172.21.15.73:0/283014450 conn(0x7fc7740a8050 msgr2=0x7fc7740a4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:53.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.874+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 shutdown_connections 2024-09-11T02:00:53.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:53.874+0000 7fc77c62b640 1 -- 172.21.15.73:0/283014450 wait complete. 2024-09-11T02:00:56.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:00:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.993+0000 7f337e0f6640 10 monclient: get_monmap_and_config 2024-09-11T02:00:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.993+0000 7f337e0f6640 10 monclient: build_initial_monmap 2024-09-11T02:00:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.993+0000 7f337e0f6640 10 monclient: monmap: 2024-09-11T02:00:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:00:56.994707+0000 2024-09-11T02:00:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:00:56.994707+0000 2024-09-11T02:00:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.994+0000 7f337e0f6640 1 Processor -- start 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.994+0000 7f337e0f6640 1 -- start start 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.994+0000 7f337e0f6640 10 monclient: init 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 10 monclient: _add_conns ranks=[3,0,2,6,4,7,8,5,1] 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 10 monclient(hunting): picked mon.noname-g con 0x7f3378138d40 addr v1:172.21.15.203:6790/0 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 10 monclient(hunting): picked mon.noname-a con 0x7f33780a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 10 monclient(hunting): picked mon.noname-b con 0x7f337813f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337809ca00 con 0x7f33780a72f0 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33780a7070 con 0x7f337813f350 2024-09-11T02:00:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337809cee0 con 0x7f3378138d40 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 10 monclient(hunting): authenticate will time out at 898.599283s 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f3377fff640 1 -- >> v1:172.21.15.73:6790/0 conn(0x7f337813f350 legacy=0x7f3378141740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f3376ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f33780a72f0 0x7f337813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47162/0 (socket says 172.21.15.73:47162) 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f3376ffd640 1 -- 172.21.15.73:0/956510095 learned_addr learned my addr 172.21.15.73:0/956510095 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 -- 172.21.15.73:0/956510095 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071512945 0 0) 0x7f337809ca00 con 0x7f33780a72f0 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient(hunting): _negotiate 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient(hunting): my global_id is 5373 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 -- 172.21.15.73:0/956510095 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3364003520 con 0x7f33780a72f0 2024-09-11T02:00:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 -- 172.21.15.73:0/956510095 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1337246554 0 0) 0x7f3364003520 con 0x7f33780a72f0 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 -- 172.21.15.73:0/956510095 >> v1:172.21.15.203:6790/0 conn(0x7f3378138d40 legacy=0x7f3378139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 -- 172.21.15.73:0/956510095 >> v1:172.21.15.73:6790/0 conn(0x7f337813f350 legacy=0x7f3378141740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: _finish_hunting 0 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 monclient: found mon.noname-a 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 -- 172.21.15.73:0/956510095 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337809d1c0 con 0x7f33780a72f0 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: _finish_auth 0 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: _check_auth_tickets 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 -- 172.21.15.73:0/956510095 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3360001850 con 0x7f33780a72f0 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 5 monclient: authenticate success, global_id 5373 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: dump: 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 -- 172.21.15.73:0/956510095 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33600019f0 con 0x7f33780a72f0 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 1 -- 172.21.15.73:0/956510095 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3360004be0 con 0x7f33780a72f0 2024-09-11T02:00:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 10 monclient: get_monmap_and_config success 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f337e0f6640 4 set_mon_vals no callback set 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.995+0000 7f33767fc640 10 monclient: dump: 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.996+0000 7f337e0f6640 10 monclient: shutdown 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.996+0000 7f337e0f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.996+0000 7f337e0f6640 1 -- 172.21.15.73:0/956510095 >> v1:172.21.15.73:6789/0 conn(0x7f33780a72f0 legacy=0x7f337813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.996+0000 7f337e0f6640 1 -- 172.21.15.73:0/956510095 shutdown_connections 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.996+0000 7f337e0f6640 1 -- 172.21.15.73:0/956510095 >> 172.21.15.73:0/956510095 conn(0x7f33780a8050 msgr2=0x7f33780a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.996+0000 7f337e0f6640 1 -- 172.21.15.73:0/956510095 shutdown_connections 2024-09-11T02:00:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.996+0000 7f337e0f6640 1 -- 172.21.15.73:0/956510095 wait complete. 2024-09-11T02:00:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.997+0000 7f337e0f6640 10 monclient: build_initial_monmap 2024-09-11T02:00:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.997+0000 7f337e0f6640 10 monclient: monmap: 2024-09-11T02:00:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:00:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:00:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:00:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:00:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:00:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:00:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:00:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:00:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:00:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:00:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:00:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:00:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.997+0000 7f337e0f6640 1 Processor -- start 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.997+0000 7f337e0f6640 1 -- start start 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.997+0000 7f337e0f6640 10 monclient: init 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 10 monclient: _reopen_session rank -1 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 10 monclient: _add_conns ranks=[1,7,8,6,5,4,2,3,0] 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 10 monclient(hunting): picked mon.noname-f con 0x7f33780a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 10 monclient(hunting): picked mon.noname-i con 0x7f3378138d40 addr v1:172.21.15.203:6792/0 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 10 monclient(hunting): picked mon.noname-e con 0x7f337813f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337813c820 con 0x7f33780a72f0 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337813cd20 con 0x7f3378138d40 2024-09-11T02:00:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337813d000 con 0x7f337813f350 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 10 monclient(hunting): _renew_subs 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f337e0f6640 10 monclient(hunting): authenticate will time out at 898.602317s 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f3377fff640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f337813f350 0x7f33781d5ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53696/0 (socket says 172.21.15.73:53696) 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f3377fff640 1 -- 172.21.15.73:0/2632899966 learned_addr learned my addr 172.21.15.73:0/2632899966 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3059939935 0 0) 0x7f337813d000 con 0x7f337813f350 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): my global_id is 114326 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3358003520 con 0x7f337813f350 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153065157 0 0) 0x7f337813cd20 con 0x7f3378138d40 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): my global_id is 5155 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337813d000 con 0x7f3378138d40 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3313844976 0 0) 0x7f337813c820 con 0x7f33780a72f0 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): my global_id is 5068 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337813cd20 con 0x7f33780a72f0 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3926996046 0 0) 0x7f3358003520 con 0x7f337813f350 2024-09-11T02:00:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f337813c820 con 0x7f337813f350 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3370004190 con 0x7f337813f350 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): dump: 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:00:57.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 349106922 0 0) 0x7f337813c820 con 0x7f337813f350 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 >> v1:172.21.15.203:6792/0 conn(0x7f3378138d40 legacy=0x7f33781d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 >> v1:172.21.15.203:6789/0 conn(0x7f33780a72f0 legacy=0x7f337813e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 10 monclient: _finish_hunting 0 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.998+0000 7f336ffff640 1 monclient: found mon.e 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337813ef20 con 0x7f337813f350 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 10 monclient: _finish_auth 0 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 10 monclient: _check_auth_tickets 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f337e0f6640 5 monclient: authenticate success, global_id 114326 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f337e0f6640 10 monclient: _renew_subs 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f337e0f6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:57.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f337813bb80 con 0x7f337813f350 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f337e0f6640 10 monclient: _renew_subs 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f337e0f6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f33781cd310 con 0x7f337813f350 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3370004330 con 0x7f337813f350 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3370004920 con 0x7f337813f350 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f336ffff640 10 monclient: dump: 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:57.020 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:00:57.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:56.999+0000 7f3375ffb640 4 set_mon_vals no callback set 2024-09-11T02:00:57.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.000+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f3370004b40 con 0x7f337813f350 2024-09-11T02:00:57.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.000+0000 7f337e0f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:57.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.000+0000 7f337e0f6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:57.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.000+0000 7f337e0f6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:57.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.000+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335c005080 con 0x7f337813f350 2024-09-11T02:00:57.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.000+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 221922906 0 0) 0x7f337004e2e0 con 0x7f337813f350 2024-09-11T02:00:57.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.000+0000 7f33777fe640 10 monclient: get_auth_request con 0x7f335803ff90 auth_method 0 2024-09-11T02:00:57.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.005+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f3370017510 con 0x7f337813f350 2024-09-11T02:00:57.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.005+0000 7f336ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:00:57.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.005+0000 7f336ffff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:00:57.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.244+0000 7f337e0f6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:00:57.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.244+0000 7f337e0f6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:00:57.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.244+0000 7f337e0f6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:00:57.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.244+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f335c005370 con 0x7f337813f350 2024-09-11T02:00:57.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.244+0000 7f336ffff640 1 -- 172.21.15.73:0/2632899966 <== mon.8 v1:172.21.15.73:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 697927125) 0x7f3370016e10 con 0x7f337813f350 2024-09-11T02:00:57.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.244+0000 7f336ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:00:57.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.244+0000 7f336ffff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:00:57.246 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":32,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"b","quorum_age":8,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:00:57.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.246+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 >> v1:172.21.15.203:6812/2311533528 conn(0x7f335803ff90 legacy=0x7f3358042450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:57.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.246+0000 7f337e0f6640 10 monclient: shutdown 2024-09-11T02:00:57.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.246+0000 7f337e0f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:00:57.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.246+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 >> v1:172.21.15.73:6793/0 conn(0x7f337813f350 legacy=0x7f33781d5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:00:57.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.246+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 shutdown_connections 2024-09-11T02:00:57.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.246+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 >> 172.21.15.73:0/2632899966 conn(0x7f33780a8050 msgr2=0x7f33780a0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:00:57.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.246+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 shutdown_connections 2024-09-11T02:00:57.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:00:57.246+0000 7f337e0f6640 1 -- 172.21.15.73:0/2632899966 wait complete. 2024-09-11T02:01:00.259 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:01:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.366+0000 7fa409573640 10 monclient: get_monmap_and_config 2024-09-11T02:01:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.366+0000 7fa409573640 10 monclient: build_initial_monmap 2024-09-11T02:01:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.366+0000 7fa409573640 10 monclient: monmap: 2024-09-11T02:01:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:01:00.367634+0000 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:01:00.367634+0000 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:00.369 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:00.370 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 1 Processor -- start 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 1 -- start start 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 10 monclient: init 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 10 monclient: _add_conns ranks=[1,8,4,5,6,2,3,7,0] 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 10 monclient(hunting): picked mon.noname-f con 0x7fa404138d40 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 10 monclient(hunting): picked mon.noname-e con 0x7fa4040a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 10 monclient(hunting): picked mon.noname-c con 0x7fa40413f350 addr v1:172.21.15.73:6791/0 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa40409ca00 con 0x7fa404138d40 2024-09-11T02:01:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.367+0000 7fa409573640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4040a7070 con 0x7fa40413f350 2024-09-11T02:01:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.368+0000 7fa409573640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa40409cee0 con 0x7fa4040a72f0 2024-09-11T02:01:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.368+0000 7fa409573640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.368+0000 7fa409573640 10 monclient(hunting): authenticate will time out at 901.972016s 2024-09-11T02:01:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.368+0000 7fa4037fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fa40413f350 0x7fa404141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40406/0 (socket says 172.21.15.73:40406) 2024-09-11T02:01:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.368+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 learned_addr learned my addr 172.21.15.73:0/1583952147 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:00.368+0000 7fa4027fc640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fa4040a72f0 0x7fa40413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:53700/0 (socket says 172.21.15.73:53700) 2024-09-11T02:01:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 10 monclient(hunting): tick 2024-09-11T02:01:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 10 monclient(hunting): _check_auth_tickets 2024-09-11T02:01:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 1 monclient(hunting): continuing hunt 2024-09-11T02:01:03.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 10 monclient(hunting): _reopen_session rank -1 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6793/0 conn(0x7fa4040a72f0 legacy=0x7fa40413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6791/0 conn(0x7fa40413f350 legacy=0x7fa404141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.203:6789/0 conn(0x7fa404138d40 legacy=0x7fa404139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 10 monclient: _add_conns ranks=[3,5,2,6,0,7] 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-g con 0x7fa3f00037e0 addr v1:172.21.15.203:6790/0 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-h con 0x7fa3f0007470 addr v1:172.21.15.203:6791/0 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6790/0 conn(0x7fa3f000b1c0 legacy=0x7fa3f000d660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-b con 0x7fa3f000b1c0 addr v1:172.21.15.73:6790/0 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa40409d1c0 con 0x7fa3f000b1c0 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f000ffe0 con 0x7fa3f00037e0 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f0011280 con 0x7fa3f0007470 2024-09-11T02:01:03.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.367+0000 7fa400ff9640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:03.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.569+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6790/0 conn(0x7fa3f000b1c0 legacy=0x7fa3f000d660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:03.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:03.970+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6790/0 conn(0x7fa3f000b1c0 legacy=0x7fa3f000d660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:04.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:04.771+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6790/0 conn(0x7fa3f000b1c0 legacy=0x7fa3f000d660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:06.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 10 monclient(hunting): tick 2024-09-11T02:01:06.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 10 monclient(hunting): _check_auth_tickets 2024-09-11T02:01:06.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 1 monclient(hunting): continuing hunt 2024-09-11T02:01:06.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 10 monclient(hunting): _reopen_session rank -1 2024-09-11T02:01:06.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.203:6791/0 conn(0x7fa3f0007470 legacy=0x7fa3f0009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:06.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.203:6790/0 conn(0x7fa3f00037e0 legacy=0x7fa3f0005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:06.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6790/0 conn(0x7fa3f000b1c0 legacy=0x7fa3f000d660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:01:06.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 10 monclient: _add_conns ranks=[6,0,7] 2024-09-11T02:01:06.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 reap_dead start 2024-09-11T02:01:06.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-d con 0x7fa3f00116b0 addr v1:172.21.15.73:6792/0 2024-09-11T02:01:06.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 reap_dead start 2024-09-11T02:01:06.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-a con 0x7fa3f000a0c0 addr v1:172.21.15.73:6789/0 2024-09-11T02:01:06.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-i con 0x7fa3f000a4a0 addr v1:172.21.15.203:6792/0 2024-09-11T02:01:06.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.367+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f00125e0 con 0x7fa3f000a0c0 2024-09-11T02:01:06.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.368+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa40409d1c0 con 0x7fa3f00116b0 2024-09-11T02:01:06.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.368+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f000a9f0 con 0x7fa3f000a4a0 2024-09-11T02:01:06.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:06.368+0000 7fa400ff9640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:09.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 10 monclient(hunting): tick 2024-09-11T02:01:09.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 10 monclient(hunting): _check_auth_tickets 2024-09-11T02:01:09.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 1 monclient(hunting): continuing hunt 2024-09-11T02:01:09.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 10 monclient(hunting): _reopen_session rank -1 2024-09-11T02:01:09.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.203:6792/0 conn(0x7fa3f000a4a0 legacy=0x7fa3f0009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:09.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6792/0 conn(0x7fa3f00116b0 legacy=0x7fa3f0011a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6789/0 conn(0x7fa3f000a0c0 legacy=0x7fa3f0005c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 10 monclient: _add_conns ranks=[5,1,4,8,6,0,3,7,2] 2024-09-11T02:01:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-h con 0x7fa3f000de30 addr v1:172.21.15.203:6791/0 2024-09-11T02:01:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-f con 0x7fa3f000e210 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-c con 0x7fa3f0018950 addr v1:172.21.15.73:6791/0 2024-09-11T02:01:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f000aca0 con 0x7fa3f000e210 2024-09-11T02:01:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f001d6b0 con 0x7fa3f0018950 2024-09-11T02:01:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f001e950 con 0x7fa3f000de30 2024-09-11T02:01:09.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:09.369+0000 7fa400ff9640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:12.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 10 monclient(hunting): tick 2024-09-11T02:01:12.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 10 monclient(hunting): _check_auth_tickets 2024-09-11T02:01:12.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 1 monclient(hunting): continuing hunt 2024-09-11T02:01:12.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 10 monclient(hunting): _reopen_session rank -1 2024-09-11T02:01:12.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.203:6791/0 conn(0x7fa3f000de30 legacy=0x7fa3f000d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:12.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6791/0 conn(0x7fa3f0018950 legacy=0x7fa3f001ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:12.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.203:6789/0 conn(0x7fa3f000e210 legacy=0x7fa3f000e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 reap_dead start 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 10 monclient: _add_conns ranks=[6,0,2,7,8,3] 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-d con 0x7fa3f0011a90 addr v1:172.21.15.73:6792/0 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-a con 0x7fa3f001cf30 addr v1:172.21.15.73:6789/0 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 reap_dead start 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 10 monclient(hunting): picked mon.noname-b con 0x7fa3f000e5f0 addr v1:172.21.15.73:6790/0 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f001fbf0 con 0x7fa3f001cf30 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f0011ed0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3f000ea00 con 0x7fa3f0011a90 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.369+0000 7fa400ff9640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:12.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.370+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6790/0 conn(0x7fa3f000e5f0 legacy=0x7fa3f0005c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:12.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.571+0000 7fa4037fe640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6790/0 conn(0x7fa3f000e5f0 legacy=0x7fa3f0005c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722616884 0 0) 0x7fa3f001fbf0 con 0x7fa3f001cf30 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 10 monclient(hunting): my global_id is 5382 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3ec003520 con 0x7fa3f001cf30 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645205255 0 0) 0x7fa3f000ea00 con 0x7fa3f0011a90 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:12.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 10 monclient(hunting): my global_id is 114288 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.647+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f001fbf0 con 0x7fa3f0011a90 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1271597963 0 0) 0x7fa3f001fbf0 con 0x7fa3f0011a90 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6790/0 conn(0x7fa3f000e5f0 legacy=0x7fa3f0005c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6789/0 conn(0x7fa3f001cf30 legacy=0x7fa3f000d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 1 monclient: found mon.noname-d 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f001d310 con 0x7fa3f0011a90 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: _finish_auth 0 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:01:12.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3f4001730 con 0x7fa3f0011a90 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: dump: 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa409573640 5 monclient: authenticate success, global_id 114288 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa409573640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3f40018d0 con 0x7fa3f0011a90 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 1 -- 172.21.15.73:0/1583952147 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3f40035f0 con 0x7fa3f0011a90 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa409573640 10 monclient: get_monmap_and_config success 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa409573640 4 set_mon_vals no callback set 2024-09-11T02:01:12.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.648+0000 7fa401ffb640 10 monclient: dump: 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:12.655 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.649+0000 7fa409573640 10 monclient: shutdown 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.649+0000 7fa409573640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.649+0000 7fa409573640 1 -- 172.21.15.73:0/1583952147 >> v1:172.21.15.73:6792/0 conn(0x7fa3f0011a90 legacy=0x7fa3f001c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.649+0000 7fa409573640 1 -- 172.21.15.73:0/1583952147 shutdown_connections 2024-09-11T02:01:12.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.649+0000 7fa409573640 1 -- 172.21.15.73:0/1583952147 >> 172.21.15.73:0/1583952147 conn(0x7fa4040a8050 msgr2=0x7fa4040a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:12.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.649+0000 7fa409573640 1 -- 172.21.15.73:0/1583952147 shutdown_connections 2024-09-11T02:01:12.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.649+0000 7fa409573640 1 -- 172.21.15.73:0/1583952147 wait complete. 2024-09-11T02:01:12.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.650+0000 7fa409573640 10 monclient: build_initial_monmap 2024-09-11T02:01:12.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.650+0000 7fa409573640 10 monclient: monmap: 2024-09-11T02:01:12.658 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:12.658 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:12.659 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.651+0000 7fa409573640 1 Processor -- start 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.651+0000 7fa409573640 1 -- start start 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.651+0000 7fa409573640 10 monclient: init 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.651+0000 7fa409573640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.651+0000 7fa409573640 10 monclient: _add_conns ranks=[5,2,8,7,4,6,3,1,0] 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa409573640 10 monclient(hunting): picked mon.noname-h con 0x7fa3f000e5f0 addr v1:172.21.15.203:6791/0 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa409573640 10 monclient(hunting): picked mon.noname-b con 0x7fa3f0011a90 addr v1:172.21.15.73:6790/0 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa409573640 10 monclient(hunting): picked mon.noname-e con 0x7fa3f001cf30 addr v1:172.21.15.73:6793/0 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa409573640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4041385c0 con 0x7fa3f0011a90 2024-09-11T02:01:12.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa409573640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4041231c0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa4027fc640 1 -- >> v1:172.21.15.73:6790/0 conn(0x7fa3f0011a90 legacy=0x7fa4041d2710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:12.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa409573640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4040aa990 con 0x7fa3f001cf30 2024-09-11T02:01:12.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa409573640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:12.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa409573640 10 monclient(hunting): authenticate will time out at 914.256156s 2024-09-11T02:01:12.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa4037fe640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fa3f001cf30 0x7fa4041d5e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:39678/0 (socket says 172.21.15.73:39678) 2024-09-11T02:01:12.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.652+0000 7fa4037fe640 1 -- 172.21.15.73:0/2344027454 learned_addr learned my addr 172.21.15.73:0/2344027454 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:12.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4273726266 0 0) 0x7fa4041231c0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient(hunting): my global_id is 5333 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f0011eb0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 565042362 0 0) 0x7fa3f0011eb0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4041231c0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3f4001670 con 0x7fa3f000e5f0 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient(hunting): dump: 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:12.665 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 133328565 0 0) 0x7fa4041231c0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 >> v1:172.21.15.73:6793/0 conn(0x7fa3f001cf30 legacy=0x7fa4041d5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 >> v1:172.21.15.73:6790/0 conn(0x7fa3f0011a90 legacy=0x7fa4041d2710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 monclient: found mon.h 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40413dc80 con 0x7fa3f000e5f0 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient: _finish_auth 0 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:01:12.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa3eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa409573640 5 monclient: authenticate success, global_id 5333 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa409573640 10 monclient: _renew_subs 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa409573640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.658+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 --> v1:172.21.15.203:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa404122ee0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa409573640 10 monclient: _renew_subs 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa409573640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 --> v1:172.21.15.203:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa404137ed0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3f40038a0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa3eb7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa3f4003e50 con 0x7fa3f000e5f0 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa3eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa4017fa640 4 set_mon_vals no callback set 2024-09-11T02:01:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa3eb7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa3eb7fe640 10 monclient: dump: 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.659+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fa3f4004070 con 0x7fa3f000e5f0 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.660+0000 7fa409573640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.660+0000 7fa409573640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.660+0000 7fa409573640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.660+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 --> v1:172.21.15.203:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e4005080 con 0x7fa3f000e5f0 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.660+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 221922906 0 0) 0x7fa3f404cfa0 con 0x7fa3f000e5f0 2024-09-11T02:01:12.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.660+0000 7fa4027fc640 10 monclient: get_auth_request con 0x7fa3f00439d0 auth_method 0 2024-09-11T02:01:12.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.665+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fa3f4016300 con 0x7fa3f000e5f0 2024-09-11T02:01:12.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.665+0000 7fa3eb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:12.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.665+0000 7fa3eb7fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:01:12.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36554]: starting. 2024-09-11T02:01:12.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36554]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36552 2024-09-11T02:01:12.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36554]: shutting down. 2024-09-11T02:01:12.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.927+0000 7fa409573640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:01:12.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.927+0000 7fa409573640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:01:12.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.927+0000 7fa409573640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.203:6791/0 2024-09-11T02:01:12.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.927+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 --> v1:172.21.15.203:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa3e4005370 con 0x7fa3f000e5f0 2024-09-11T02:01:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.928+0000 7fa3eb7fe640 1 -- 172.21.15.73:0/2344027454 <== mon.5 v1:172.21.15.203:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2723 (unknown 254746657 0 2957900715) 0x7fa3f4015c00 con 0x7fa3f000e5f0 2024-09-11T02:01:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.928+0000 7fa3eb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:01:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.928+0000 7fa3eb7fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:01:12.930 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":38,"quorum":[0,1,3,4,5,6,7,8],"quorum_names":["a","f","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:01:12.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.930+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 >> v1:172.21.15.203:6812/2311533528 conn(0x7fa3f00439d0 legacy=0x7fa3f0045e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:12.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.930+0000 7fa409573640 10 monclient: shutdown 2024-09-11T02:01:12.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.930+0000 7fa409573640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:12.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.930+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 >> v1:172.21.15.203:6791/0 conn(0x7fa3f000e5f0 legacy=0x7fa4041377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:12.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.930+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 shutdown_connections 2024-09-11T02:01:12.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.930+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 >> 172.21.15.73:0/2344027454 conn(0x7fa4040a8050 msgr2=0x7fa4040a0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:12.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.930+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 shutdown_connections 2024-09-11T02:01:12.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:12.930+0000 7fa409573640 1 -- 172.21.15.73:0/2344027454 wait complete. 2024-09-11T02:01:12.943 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-09-11T02:01:12.943 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-09-11T02:01:12.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T02:01:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.040+0000 7feb2b333640 10 monclient: get_monmap_and_config 2024-09-11T02:01:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.040+0000 7feb2b333640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.040+0000 7feb2b333640 10 monclient: monmap: 2024-09-11T02:01:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:01:13.041139+0000 2024-09-11T02:01:13.042 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:01:13.041139+0000 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.040+0000 7feb2b333640 1 Processor -- start 2024-09-11T02:01:13.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 1 -- start start 2024-09-11T02:01:13.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 10 monclient: init 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 10 monclient: _add_conns ranks=[1,6,2,4,5,3,0,7,8] 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 10 monclient(hunting): picked mon.noname-f con 0x7feb24138960 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 10 monclient(hunting): picked mon.noname-d con 0x7feb24139450 addr v1:172.21.15.73:6792/0 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 10 monclient(hunting): picked mon.noname-b con 0x7feb2413f620 addr v1:172.21.15.73:6790/0 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2409d030 con 0x7feb24138960 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2409d310 con 0x7feb2413f620 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2406f770 con 0x7feb24139450 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb2b333640 10 monclient(hunting): authenticate will time out at 914.645529s 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb298d0640 1 -- >> v1:172.21.15.73:6790/0 conn(0x7feb2413f620 legacy=0x7feb24141a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:13.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb288ce640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7feb24139450 0x7feb2413df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:58046/0 (socket says 172.21.15.73:58046) 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb288ce640 1 -- 172.21.15.73:0/160610667 learned_addr learned my addr 172.21.15.73:0/160610667 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309870787 0 0) 0x7feb2406f770 con 0x7feb24139450 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb17fff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb17fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb17fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb17fff640 10 monclient(hunting): my global_id is 114333 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.041+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb10003520 con 0x7feb24139450 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550598537 0 0) 0x7feb2409d030 con 0x7feb24138960 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient(hunting): my global_id is 5104 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb2406f770 con 0x7feb24138960 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3254730871 0 0) 0x7feb10003520 con 0x7feb24139450 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 >> v1:172.21.15.73:6790/0 conn(0x7feb2413f620 legacy=0x7feb24141a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 >> v1:172.21.15.203:6789/0 conn(0x7feb24138960 legacy=0x7feb24138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 monclient: found mon.noname-d 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb240a7360 con 0x7feb24139450 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 5 monclient: authenticate success, global_id 114333 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb20001830 con 0x7feb24139450 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: dump: 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.056 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.057 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb20001a50 con 0x7feb24139450 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 1 -- 172.21.15.73:0/160610667 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb20004be0 con 0x7feb24139450 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 10 monclient: get_monmap_and_config success 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 4 set_mon_vals no callback set 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb17fff640 10 monclient: dump: 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.058 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 10 monclient: shutdown 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 1 -- 172.21.15.73:0/160610667 >> v1:172.21.15.73:6792/0 conn(0x7feb24139450 legacy=0x7feb2413df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 1 -- 172.21.15.73:0/160610667 shutdown_connections 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 1 -- 172.21.15.73:0/160610667 >> 172.21.15.73:0/160610667 conn(0x7feb240a8050 msgr2=0x7feb240a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 1 -- 172.21.15.73:0/160610667 shutdown_connections 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.042+0000 7feb2b333640 1 -- 172.21.15.73:0/160610667 wait complete. 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.043+0000 7feb2b333640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.043+0000 7feb2b333640 10 monclient: monmap: 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:01:13.060 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.043+0000 7feb2b333640 1 Processor -- start 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.043+0000 7feb2b333640 1 -- start start 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.043+0000 7feb2b333640 10 monclient: init 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 10 monclient: _add_conns ranks=[1,5,3,8,4,6,0,7,2] 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 10 monclient(hunting): picked mon.noname-f con 0x7feb24138960 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 10 monclient(hunting): picked mon.noname-h con 0x7feb24139450 addr v1:172.21.15.203:6791/0 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 10 monclient(hunting): picked mon.noname-g con 0x7feb2413f620 addr v1:172.21.15.203:6790/0 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2413ad20 con 0x7feb24138960 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb240a87e0 con 0x7feb2413f620 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2413cb40 con 0x7feb24139450 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb2b333640 10 monclient(hunting): authenticate will time out at 914.648146s 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb290cf640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7feb24138960 0x7feb24139cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.73:54800/0 (socket says 172.21.15.73:54800) 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb290cf640 1 -- 172.21.15.73:0/2738650575 learned_addr learned my addr 172.21.15.73:0/2738650575 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425642501 0 0) 0x7feb2413ad20 con 0x7feb24138960 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): my global_id is 5113 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb08003520 con 0x7feb24138960 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422671306 0 0) 0x7feb2413cb40 con 0x7feb24139450 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): my global_id is 5360 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb2413ad20 con 0x7feb24139450 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174751663 0 0) 0x7feb1c003d30 con 0x7feb2413f620 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): my global_id is 5286 2024-09-11T02:01:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb2413cb40 con 0x7feb2413f620 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3147524512 0 0) 0x7feb08003520 con 0x7feb24138960 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb1c003d30 con 0x7feb24138960 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2439994797 0 0) 0x7feb2413ad20 con 0x7feb24139450 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb08003520 con 0x7feb24139450 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb18001b30 con 0x7feb24138960 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): dump: 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.064 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb20004b20 con 0x7feb24139450 2024-09-11T02:01:13.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): dump: 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 334171302 0 0) 0x7feb2413cb40 con 0x7feb2413f620 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb2413ad20 con 0x7feb2413f620 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb1c004660 con 0x7feb2413f620 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.044+0000 7feb15ffb640 10 monclient(hunting): dump: 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 324478336 0 0) 0x7feb1c003d30 con 0x7feb24138960 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 >> v1:172.21.15.203:6791/0 conn(0x7feb24139450 legacy=0x7feb2413a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 >> v1:172.21.15.203:6790/0 conn(0x7feb2413f620 legacy=0x7feb241d5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 1 monclient: found mon.f 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2413ce20 con 0x7feb24138960 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb2b333640 5 monclient: authenticate success, global_id 5113 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb2b333640 10 monclient: _renew_subs 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb2b333640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T02:01:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.203:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb2413aaf0 con 0x7feb24138960 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.1 v1:172.21.15.203:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb180038c0 con 0x7feb24138960 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.1 v1:172.21.15.203:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb18003df0 con 0x7feb24138960 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb15ffb640 10 monclient: dump: 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb177fe640 4 set_mon_vals no callback set 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb2b333640 10 monclient: _renew_subs 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb2b333640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.203:6789/0 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.045+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.203:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feb2413b620 con 0x7feb24138960 2024-09-11T02:01:13.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb2b333640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb2409ea90 con 0x7feb24143130 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.1 v1:172.21.15.203:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7feb18004010 con 0x7feb24138960 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.1 v1:172.21.15.203:6789/0 8 ==== osd_map(121..121 src has 1..121) ==== 3506+0+0 (unknown 3091721711 0 0) 0x7feb1804e340 con 0x7feb24138960 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3905600997 0 0) 0x7feb08003520 con 0x7feb24143130 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 10 monclient(hunting): my global_id is 5400 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb1c003d30 con 0x7feb24143130 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb298d0640 10 monclient: get_auth_request con 0x7feb08040760 auth_method 0 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3301973158 0 0) 0x7feb1c003d30 con 0x7feb24143130 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb08003520 con 0x7feb24143130 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb20001b50 con 0x7feb24143130 2024-09-11T02:01:13.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 10 monclient: dump: 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.073 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 441372533 0 0) 0x7feb08003520 con 0x7feb24143130 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.046+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb2406a2c0 con 0x7feb24143130 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.047+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7feb20007480 con 0x7feb24143130 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.047+0000 7feb15ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.047+0000 7feb15ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.047+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 >> v1:172.21.15.73:6789/0 conn(0x7feb24143130 legacy=0x7feb24063d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.047+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 >> v1:172.21.15.73:6789/0 conn(0x7feb24143130 legacy=0x7feb24063d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb2b333640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feb240a07c0 con 0x7feb2402e5c0 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632827396 0 0) 0x7feb240a07c0 con 0x7feb2402e5c0 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 10 monclient(hunting): my global_id is 5409 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb08003520 con 0x7feb2402e5c0 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1975765572 0 0) 0x7feb08003520 con 0x7feb2402e5c0 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb240a07c0 con 0x7feb2402e5c0 2024-09-11T02:01:13.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7feb20005680 con 0x7feb2402e5c0 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 10 monclient: dump: 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.077 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3229126322 0 0) 0x7feb240a07c0 con 0x7feb2402e5c0 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.053+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 --> v1:172.21.15.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feb2402e9a0 con 0x7feb2402e5c0 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7700 (unknown 0 0 524052476) 0x7feb20006b70 con 0x7feb2402e5c0 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb15ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb15ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 >> v1:172.21.15.73:6789/0 conn(0x7feb2402e5c0 legacy=0x7feb240a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb15ffb640 1 -- 172.21.15.73:0/2738650575 >> v1:172.21.15.73:6789/0 conn(0x7feb2402e5c0 legacy=0x7feb240a00b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 38, 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 195494, 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:01:13.079 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.080 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:01:13.082 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.083 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:01:13.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.085 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:01:13.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.085 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:01:13.085 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:01:13.085 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.085 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.085 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.085 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:01:13.086 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.087 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.089 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:01:13.090 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.092 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.096 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.099 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:01:13.099 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:01:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 >> v1:172.21.15.203:6812/2311533528 conn(0x7feb08040760 legacy=0x7feb08042c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb2b333640 10 monclient: shutdown 2024-09-11T02:01:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb2b333640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 >> v1:172.21.15.203:6789/0 conn(0x7feb24138960 legacy=0x7feb24139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb298d0640 1 -- 172.21.15.73:0/2738650575 reap_dead start 2024-09-11T02:01:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb298d0640 1 -- 172.21.15.73:0/2738650575 reap_dead start 2024-09-11T02:01:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 shutdown_connections 2024-09-11T02:01:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 >> 172.21.15.73:0/2738650575 conn(0x7feb240a8050 msgr2=0x7feb240a97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 shutdown_connections 2024-09-11T02:01:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.054+0000 7feb2b333640 1 -- 172.21.15.73:0/2738650575 wait complete. 2024-09-11T02:01:13.101 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-11T02:01:13.101 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-09-11T02:01:13.102 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T02:01:13.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.198+0000 7fb5053a1640 10 monclient: get_monmap_and_config 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.198+0000 7fb5053a1640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.198+0000 7fb5053a1640 10 monclient: monmap: 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:01:13.199164+0000 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:01:13.199164+0000 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.200 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.201 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 1 Processor -- start 2024-09-11T02:01:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 1 -- start start 2024-09-11T02:01:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 10 monclient: init 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 10 monclient: _add_conns ranks=[6,7,8,0,4,1,2,3,5] 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 10 monclient(hunting): picked mon.noname-d con 0x7fb5000a4100 addr v1:172.21.15.73:6792/0 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 10 monclient(hunting): picked mon.noname-i con 0x7fb5000a4bf0 addr v1:172.21.15.203:6792/0 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 10 monclient(hunting): picked mon.noname-e con 0x7fb5000a3b00 addr v1:172.21.15.73:6793/0 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5000a2e10 con 0x7fb5000a4100 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5000a2b30 con 0x7fb5000a4bf0 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5000a30f0 con 0x7fb5000a3b00 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb5053a1640 10 monclient(hunting): authenticate will time out at 914.803606s 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb504ba0640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fb5000a3b00 0x7fb5001410f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:39688/0 (socket says 172.21.15.73:39688) 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb504ba0640 1 -- 172.21.15.73:0/650150506 learned_addr learned my addr 172.21.15.73:0/650150506 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4fffff640 1 --1- 172.21.15.73:0/650150506 >> v1:172.21.15.73:6792/0 conn(0x7fb5000a4100 0x7fb5000a44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:58056/0 (socket says 172.21.15.73:58056) 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878825148 0 0) 0x7fb5000a30f0 con 0x7fb5000a3b00 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 10 monclient(hunting): my global_id is 114362 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4ec003520 con 0x7fb5000a3b00 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703735764 0 0) 0x7fb4f0001040 con 0x7fb5000a4100 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 10 monclient(hunting): my global_id is 114342 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.199+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5000a30f0 con 0x7fb5000a4100 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3241270218 0 0) 0x7fb5000a30f0 con 0x7fb5000a4100 2024-09-11T02:01:13.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 >> v1:172.21.15.73:6793/0 conn(0x7fb5000a3b00 legacy=0x7fb5001410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 >> v1:172.21.15.203:6792/0 conn(0x7fb5000a4bf0 legacy=0x7fb50013d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 1 monclient: found mon.noname-d 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5000a5430 con 0x7fb5000a4100 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 5 monclient: authenticate success, global_id 114342 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4f0001890 con 0x7fb5000a4100 2024-09-11T02:01:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: dump: 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.213 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4f0001a30 con 0x7fb5000a4100 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 10 monclient: get_monmap_and_config success 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 1 -- 172.21.15.73:0/650150506 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4f0004b20 con 0x7fb5000a4100 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 4 set_mon_vals no callback set 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:01:13.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb4feffd640 10 monclient: dump: 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.215 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 10 monclient: shutdown 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 1 -- 172.21.15.73:0/650150506 >> v1:172.21.15.73:6792/0 conn(0x7fb5000a4100 legacy=0x7fb5000a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 1 -- 172.21.15.73:0/650150506 shutdown_connections 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 1 -- 172.21.15.73:0/650150506 >> 172.21.15.73:0/650150506 conn(0x7fb5000a7ca0 msgr2=0x7fb5000a80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 1 -- 172.21.15.73:0/650150506 shutdown_connections 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.200+0000 7fb5053a1640 1 -- 172.21.15.73:0/650150506 wait complete. 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.201+0000 7fb5053a1640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.201+0000 7fb5053a1640 10 monclient: monmap: 2024-09-11T02:01:13.216 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.201+0000 7fb5053a1640 1 Processor -- start 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.201+0000 7fb5053a1640 1 -- start start 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.201+0000 7fb5053a1640 10 monclient: init 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 10 monclient: _add_conns ranks=[8,2,7,1,6,5,3,4,0] 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 10 monclient(hunting): picked mon.noname-e con 0x7fb5000a3b00 addr v1:172.21.15.73:6793/0 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 10 monclient(hunting): picked mon.noname-b con 0x7fb5000a4100 addr v1:172.21.15.73:6790/0 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 10 monclient(hunting): picked mon.noname-i con 0x7fb5000a4bf0 addr v1:172.21.15.203:6792/0 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5001415d0 con 0x7fb5000a4100 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50013a940 con 0x7fb5000a4bf0 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5000a63c0 con 0x7fb5000a3b00 2024-09-11T02:01:13.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4ff7fe640 1 -- >> v1:172.21.15.73:6790/0 conn(0x7fb5000a4100 legacy=0x7fb50013a230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb5053a1640 10 monclient(hunting): authenticate will time out at 914.806442s 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fffff640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fb5000a3b00 0x7fb500139b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:39698/0 (socket says 172.21.15.73:39698) 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fffff640 1 -- 172.21.15.73:0/3877901412 learned_addr learned my addr 172.21.15.73:0/3877901412 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105916076 0 0) 0x7fb5000a63c0 con 0x7fb5000a3b00 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): my global_id is 114371 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e0003520 con 0x7fb5000a3b00 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174359474 0 0) 0x7fb50013a940 con 0x7fb5000a4bf0 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): my global_id is 5191 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5000a63c0 con 0x7fb5000a4bf0 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2081973089 0 0) 0x7fb4e0003520 con 0x7fb5000a3b00 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb50013a940 con 0x7fb5000a3b00 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4f0001490 con 0x7fb5000a3b00 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): dump: 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:01:13.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.202+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 102956814 0 0) 0x7fb50013a940 con 0x7fb5000a3b00 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 >> v1:172.21.15.203:6792/0 conn(0x7fb5000a4bf0 legacy=0x7fb5001d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 >> v1:172.21.15.73:6790/0 conn(0x7fb5000a4100 legacy=0x7fb50013a230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 1 monclient: found mon.e 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb500122b70 con 0x7fb5000a3b00 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb5053a1640 5 monclient: authenticate success, global_id 114371 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb5053a1640 10 monclient: _renew_subs 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb5053a1640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:01:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb500140450 con 0x7fb5000a3b00 2024-09-11T02:01:13.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb5053a1640 10 monclient: _renew_subs 2024-09-11T02:01:13.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb5053a1640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:01:13.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5001d7410 con 0x7fb5000a3b00 2024-09-11T02:01:13.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4f00018e0 con 0x7fb5000a3b00 2024-09-11T02:01:13.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4f0001270 con 0x7fb5000a3b00 2024-09-11T02:01:13.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:01:13.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fe7fc640 4 set_mon_vals no callback set 2024-09-11T02:01:13.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb4fcff9640 10 monclient: dump: 2024-09-11T02:01:13.224 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.224 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.224 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.224 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb5053a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.203+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb4e40065c0 con 0x7fb4e4002860 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fb4f00116c0 con 0x7fb5000a3b00 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(121..121 src has 1..121) ==== 3506+0+0 (unknown 3091721711 0 0) 0x7fb4f004e290 con 0x7fb5000a3b00 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554297332 0 0) 0x7fb4e40065c0 con 0x7fb4e4002860 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 10 monclient(hunting): my global_id is 5161 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb50013a940 con 0x7fb4e4002860 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb504ba0640 10 monclient: get_auth_request con 0x7fb4e003fd60 auth_method 0 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 896935810 0 0) 0x7fb50013a940 con 0x7fb4e4002860 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4e40065c0 con 0x7fb4e4002860 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4e80017a0 con 0x7fb4e4002860 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 10 monclient: dump: 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.227 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 928020086 0 0) 0x7fb4e40065c0 con 0x7fb4e4002860 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.204+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4e400a160 con 0x7fb4e4002860 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.205+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb4e8001c00 con 0x7fb4e4002860 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.205+0000 7fb4fcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.205+0000 7fb4fcff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.205+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 >> v1:172.21.15.73:6791/0 conn(0x7fb4e4002860 legacy=0x7fb4e4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.205+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 >> v1:172.21.15.73:6791/0 conn(0x7fb4e4002860 legacy=0x7fb4e4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb5053a1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:01:13.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb4e4009e70 con 0x7fb4e4009130 2024-09-11T02:01:13.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707866268 0 0) 0x7fb4e4009e70 con 0x7fb4e4009130 2024-09-11T02:01:13.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 10 monclient(hunting): my global_id is 5170 2024-09-11T02:01:13.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e40065c0 con 0x7fb4e4009130 2024-09-11T02:01:13.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4273637760 0 0) 0x7fb4e40065c0 con 0x7fb4e4009130 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4e4009e70 con 0x7fb4e4009130 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4e8003c60 con 0x7fb4e4009130 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 10 monclient: dump: 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.231 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2905826812 0 0) 0x7fb4e4009e70 con 0x7fb4e4009130 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 --> v1:172.21.15.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb4e400c410 con 0x7fb4e4009130 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7533 (unknown 0 0 337843409) 0x7fb4e80057c0 con 0x7fb4e4009130 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:01:13.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 >> v1:172.21.15.73:6791/0 conn(0x7fb4e4009130 legacy=0x7fb4e40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.211+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3877901412 >> v1:172.21.15.73:6791/0 conn(0x7fb4e4009130 legacy=0x7fb4e40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 38, 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 195674, 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:01:13.233 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.234 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.235 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:01:13.236 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:01:13.237 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.238 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.239 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.240 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.241 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.242 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.243 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.245 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.246 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.248 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:01:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.250 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.251 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.252 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.252 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.252 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:01:13.252 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:01:13.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 >> v1:172.21.15.203:6812/2311533528 conn(0x7fb4e003fd60 legacy=0x7fb4e0042220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb5053a1640 10 monclient: shutdown 2024-09-11T02:01:13.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb5053a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 >> v1:172.21.15.73:6793/0 conn(0x7fb5000a3b00 legacy=0x7fb500139b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb504ba0640 1 -- 172.21.15.73:0/3877901412 reap_dead start 2024-09-11T02:01:13.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb504ba0640 1 -- 172.21.15.73:0/3877901412 reap_dead start 2024-09-11T02:01:13.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 shutdown_connections 2024-09-11T02:01:13.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 >> 172.21.15.73:0/3877901412 conn(0x7fb5000a7ca0 msgr2=0x7fb5000a8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 shutdown_connections 2024-09-11T02:01:13.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.212+0000 7fb5053a1640 1 -- 172.21.15.73:0/3877901412 wait complete. 2024-09-11T02:01:13.254 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-11T02:01:13.254 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-09-11T02:01:13.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-11T02:01:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.352+0000 7f44e6a16640 10 monclient: get_monmap_and_config 2024-09-11T02:01:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.352+0000 7f44e6a16640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.352+0000 7f44e6a16640 10 monclient: monmap: 2024-09-11T02:01:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:01:13.353399+0000 2024-09-11T02:01:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:01:13.353399+0000 2024-09-11T02:01:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.354 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.355 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 1 Processor -- start 2024-09-11T02:01:13.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 1 -- start start 2024-09-11T02:01:13.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 10 monclient: init 2024-09-11T02:01:13.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 10 monclient: _add_conns ranks=[3,1,7,5,8,0,6,2,4] 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 10 monclient(hunting): picked mon.noname-g con 0x7f44e0138960 addr v1:172.21.15.203:6790/0 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 10 monclient(hunting): picked mon.noname-f con 0x7f44e0139450 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 10 monclient(hunting): picked mon.noname-i con 0x7f44e013f620 addr v1:172.21.15.203:6792/0 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e009d030 con 0x7f44e0139450 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e009d310 con 0x7f44e0138960 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e006f770 con 0x7f44e013f620 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.353+0000 7f44e6a16640 10 monclient(hunting): authenticate will time out at 914.957801s 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44e4fb3640 1 --1- >> v1:172.21.15.203:6792/0 conn(0x7f44e013f620 0x7f44e0141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6792/0 says I am v1:172.21.15.73:37090/0 (socket says 172.21.15.73:37090) 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44dffff640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7f44e0138960 0x7f44e0138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.73:56824/0 (socket says 172.21.15.73:56824) 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44df7fe640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f44e0139450 0x7f44e013df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.73:54810/0 (socket says 172.21.15.73:54810) 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44e4fb3640 1 -- 172.21.15.73:0/1245565013 learned_addr learned my addr 172.21.15.73:0/1245565013 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464788587 0 0) 0x7f44e009d030 con 0x7f44e0139450 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): my global_id is 5122 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c8003520 con 0x7f44e0139450 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591454340 0 0) 0x7f44e009d310 con 0x7f44e0138960 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): my global_id is 5295 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e009d030 con 0x7f44e0138960 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569804352 0 0) 0x7f44e006f770 con 0x7f44e013f620 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient(hunting): my global_id is 5200 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e009d310 con 0x7f44e013f620 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3724578850 0 0) 0x7f44c8003520 con 0x7f44e0139450 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 >> v1:172.21.15.203:6792/0 conn(0x7f44e013f620 legacy=0x7f44e0141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 >> v1:172.21.15.203:6790/0 conn(0x7f44e0138960 legacy=0x7f44e0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 monclient: found mon.noname-f 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.203:6789/0 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e00a7360 con 0x7f44e0139450 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f44d4001760 con 0x7f44e0139450 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: dump: 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.372 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44e6a16640 5 monclient: authenticate success, global_id 5122 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44e6a16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 <== mon.1 v1:172.21.15.203:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44d4001980 con 0x7f44e0139450 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44e6a16640 10 monclient: get_monmap_and_config success 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44e6a16640 4 set_mon_vals no callback set 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 1 -- 172.21.15.73:0/1245565013 <== mon.1 v1:172.21.15.203:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f44d4004b20 con 0x7f44e0139450 2024-09-11T02:01:13.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.354+0000 7f44deffd640 10 monclient: dump: 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.374 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.355+0000 7f44e6a16640 10 monclient: shutdown 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.355+0000 7f44e6a16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.355+0000 7f44e6a16640 1 -- 172.21.15.73:0/1245565013 >> v1:172.21.15.203:6789/0 conn(0x7f44e0139450 legacy=0x7f44e013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.355+0000 7f44e6a16640 1 -- 172.21.15.73:0/1245565013 shutdown_connections 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.355+0000 7f44e6a16640 1 -- 172.21.15.73:0/1245565013 >> 172.21.15.73:0/1245565013 conn(0x7f44e00a8050 msgr2=0x7f44e00a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.355+0000 7f44e6a16640 1 -- 172.21.15.73:0/1245565013 shutdown_connections 2024-09-11T02:01:13.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.355+0000 7f44e6a16640 1 -- 172.21.15.73:0/1245565013 wait complete. 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.355+0000 7f44e6a16640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.355+0000 7f44e6a16640 10 monclient: monmap: 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.376 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.356+0000 7f44e6a16640 1 Processor -- start 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.356+0000 7f44e6a16640 1 -- start start 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.356+0000 7f44e6a16640 10 monclient: init 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.356+0000 7f44e6a16640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.356+0000 7f44e6a16640 10 monclient: _add_conns ranks=[4,2,7,8,5,3,1,0,6] 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.356+0000 7f44e6a16640 10 monclient(hunting): picked mon.noname-c con 0x7f44e0138960 addr v1:172.21.15.73:6791/0 2024-09-11T02:01:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.356+0000 7f44e6a16640 10 monclient(hunting): picked mon.noname-b con 0x7f44e0139450 addr v1:172.21.15.73:6790/0 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.356+0000 7f44e6a16640 10 monclient(hunting): picked mon.noname-i con 0x7f44e013f620 addr v1:172.21.15.203:6792/0 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.356+0000 7f44e6a16640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e0138d40 con 0x7f44e0139450 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44df7fe640 1 -- >> v1:172.21.15.73:6790/0 conn(0x7f44e0139450 legacy=0x7f44e01d2550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e00a5160 con 0x7f44e0138960 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44e013ca20 con 0x7f44e013f620 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dffff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f44e0138960 0x7f44e0137ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43142/0 (socket says 172.21.15.73:43142) 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dffff640 1 -- 172.21.15.73:0/300339680 learned_addr learned my addr 172.21.15.73:0/300339680 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 10 monclient(hunting): authenticate will time out at 914.961081s 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069112121 0 0) 0x7f44e00a5160 con 0x7f44e0138960 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): my global_id is 5179 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44cc003520 con 0x7f44e0138960 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510395033 0 0) 0x7f44e013ca20 con 0x7f44e013f620 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): my global_id is 5209 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e00a5160 con 0x7f44e013f620 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 212326662 0 0) 0x7f44cc003520 con 0x7f44e0138960 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44e013ca20 con 0x7f44e0138960 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f44d0001b90 con 0x7f44e0138960 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): dump: 2024-09-11T02:01:13.379 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3341939857 0 0) 0x7f44e00a5160 con 0x7f44e013f620 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44cc003520 con 0x7f44e013f620 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f44d8001c10 con 0x7f44e013f620 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient(hunting): dump: 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 631580503 0 0) 0x7f44e013ca20 con 0x7f44e0138960 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 >> v1:172.21.15.203:6792/0 conn(0x7f44e013f620 legacy=0x7f44e01d5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 >> v1:172.21.15.73:6790/0 conn(0x7f44e0139450 legacy=0x7f44e01d2550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:01:13.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 monclient: found mon.c 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e013c180 con 0x7f44e0138960 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 5 monclient: authenticate success, global_id 5179 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 10 monclient: _renew_subs 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44e013b220 con 0x7f44e0138960 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 10 monclient: _renew_subs 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f44e00a4920 con 0x7f44e0138960 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44d0004a90 con 0x7f44e0138960 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f44d0004f80 con 0x7f44e0138960 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44dcff9640 10 monclient: dump: 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.384 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.357+0000 7f44de7fc640 4 set_mon_vals no callback set 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.358+0000 7f44e6a16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.358+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f44e00008d0 con 0x7f44e0143130 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.358+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f44d00116c0 con 0x7f44e0138960 2024-09-11T02:01:13.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.358+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(121..121 src has 1..121) ==== 3506+0+0 (unknown 3091721711 0 0) 0x7f44d004e360 con 0x7f44e0138960 2024-09-11T02:01:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 15602756 0 0) 0x7f44e00008d0 con 0x7f44e0143130 2024-09-11T02:01:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 10 monclient(hunting): my global_id is 114351 2024-09-11T02:01:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e013ca20 con 0x7f44e0143130 2024-09-11T02:01:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44e4fb3640 10 monclient: get_auth_request con 0x7f44cc0401e0 auth_method 0 2024-09-11T02:01:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3679981898 0 0) 0x7f44e013ca20 con 0x7f44e0143130 2024-09-11T02:01:13.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44e00008d0 con 0x7f44e0143130 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f44d4001760 con 0x7f44e0143130 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 10 monclient: dump: 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.387 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2284799408 0 0) 0x7f44e00008d0 con 0x7f44e0143130 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44e013c860 con 0x7f44e0143130 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f44d40049d0 con 0x7f44e0143130 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:01:13.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 >> v1:172.21.15.73:6792/0 conn(0x7f44e0143130 legacy=0x7f44e0063d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.359+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 >> v1:172.21.15.73:6792/0 conn(0x7f44e0143130 legacy=0x7f44e0063d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.365+0000 7f44e6a16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.365+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f44e00a07c0 con 0x7f44e002e5c0 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213816231 0 0) 0x7f44e00a07c0 con 0x7f44e002e5c0 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 10 monclient(hunting): my global_id is 114360 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e00008d0 con 0x7f44e002e5c0 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4025832762 0 0) 0x7f44e00008d0 con 0x7f44e002e5c0 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44e00a07c0 con 0x7f44e002e5c0 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f44d4004b80 con 0x7f44e002e5c0 2024-09-11T02:01:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 10 monclient: dump: 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3424767165 0 0) 0x7f44e00a07c0 con 0x7f44e002e5c0 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 --> v1:172.21.15.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44e002e9a0 con 0x7f44e002e5c0 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7532 (unknown 0 0 4175314324) 0x7f44d4001cf0 con 0x7f44e002e5c0 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 >> v1:172.21.15.73:6792/0 conn(0x7f44e002e5c0 legacy=0x7f44e00a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44dcff9640 1 -- 172.21.15.73:0/300339680 >> v1:172.21.15.73:6792/0 conn(0x7f44e002e5c0 legacy=0x7f44e00a00b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 38, 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 39955, 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:01:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:01:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:01:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:01:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:01:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:01:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:01:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:01:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:01:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:01:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:01:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:01:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:01:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:01:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:01:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:01:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:01:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:01:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:01:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:01:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:01:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:01:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.414 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.414 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.416 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.416 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.416 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.416 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.417 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:01:13.417 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:01:13.417 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.417 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.417 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.417 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:01:13.418 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.418 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.418 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.418 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.418 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.419 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.420 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T02:01:13.421 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.422 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.422 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:01:13.422 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:01:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 >> v1:172.21.15.203:6812/2311533528 conn(0x7f44cc0401e0 legacy=0x7f44cc0426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44e6a16640 10 monclient: shutdown 2024-09-11T02:01:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44e6a16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 >> v1:172.21.15.73:6791/0 conn(0x7f44e0138960 legacy=0x7f44e0137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44e4fb3640 1 -- 172.21.15.73:0/300339680 reap_dead start 2024-09-11T02:01:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44e4fb3640 1 -- 172.21.15.73:0/300339680 reap_dead start 2024-09-11T02:01:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 shutdown_connections 2024-09-11T02:01:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.366+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 >> 172.21.15.73:0/300339680 conn(0x7f44e00a8050 msgr2=0x7f44e0141b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.367+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 shutdown_connections 2024-09-11T02:01:13.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.367+0000 7f44e6a16640 1 -- 172.21.15.73:0/300339680 wait complete. 2024-09-11T02:01:13.424 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-11T02:01:13.424 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-09-11T02:01:13.425 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.522+0000 7f9a1e1d3640 10 monclient: get_monmap_and_config 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.522+0000 7f9a1e1d3640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.522+0000 7f9a1e1d3640 10 monclient: monmap: 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:01:13.523121+0000 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:01:13.523121+0000 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.525 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.525 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.525 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.525 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.525 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.525 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.525 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.525 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 1 Processor -- start 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 1 -- start start 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 10 monclient: init 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 10 monclient: _add_conns ranks=[5,1,4,0,8,3,7,2,6] 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 10 monclient(hunting): picked mon.noname-h con 0x7f9a18138960 addr v1:172.21.15.203:6791/0 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 10 monclient(hunting): picked mon.noname-f con 0x7f9a18139450 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 10 monclient(hunting): picked mon.noname-c con 0x7f9a1813f620 addr v1:172.21.15.73:6791/0 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1809d030 con 0x7f9a18139450 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1809d310 con 0x7f9a1813f620 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1806f770 con 0x7f9a18138960 2024-09-11T02:01:13.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a1e1d3640 10 monclient(hunting): authenticate will time out at 915.127737s 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a17fff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f9a1813f620 0x7f9a18141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43152/0 (socket says 172.21.15.73:43152) 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.523+0000 7f9a17fff640 1 -- 172.21.15.73:0/729617670 learned_addr learned my addr 172.21.15.73:0/729617670 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722287088 0 0) 0x7f9a1809d310 con 0x7f9a1813f620 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): my global_id is 5188 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a04003520 con 0x7f9a1813f620 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694270842 0 0) 0x7f9a1806f770 con 0x7f9a18138960 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): my global_id is 5369 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a1809d310 con 0x7f9a18138960 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012100647 0 0) 0x7f9a1809d030 con 0x7f9a18139450 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient(hunting): my global_id is 5131 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a1806f770 con 0x7f9a18139450 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2016864466 0 0) 0x7f9a04003520 con 0x7f9a1813f620 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 >> v1:172.21.15.203:6791/0 conn(0x7f9a18138960 legacy=0x7f9a18138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 >> v1:172.21.15.203:6789/0 conn(0x7f9a18139450 legacy=0x7f9a1813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 monclient: found mon.noname-c 2024-09-11T02:01:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a180a7360 con 0x7f9a1813f620 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a10001b30 con 0x7f9a1813f620 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a1e1d3640 5 monclient: authenticate success, global_id 5188 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a1e1d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: dump: 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a1e1d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a10001cd0 con 0x7f9a1813f620 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 1 -- 172.21.15.73:0/729617670 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a10004f60 con 0x7f9a1813f620 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a1e1d3640 10 monclient: get_monmap_and_config success 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a1e1d3640 4 set_mon_vals no callback set 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.524+0000 7f9a167fc640 10 monclient: dump: 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 10 monclient: shutdown 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/729617670 >> v1:172.21.15.73:6791/0 conn(0x7f9a1813f620 legacy=0x7f9a18141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/729617670 shutdown_connections 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/729617670 >> 172.21.15.73:0/729617670 conn(0x7f9a180a8050 msgr2=0x7f9a180a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/729617670 shutdown_connections 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/729617670 wait complete. 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 10 monclient: monmap: 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.541 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.525+0000 7f9a1e1d3640 1 Processor -- start 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 1 -- start start 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 10 monclient: init 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 10 monclient: _add_conns ranks=[4,7,5,8,2,3,0,6,1] 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 10 monclient(hunting): picked mon.noname-c con 0x7f9a18138960 addr v1:172.21.15.73:6791/0 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 10 monclient(hunting): picked mon.noname-i con 0x7f9a18139450 addr v1:172.21.15.203:6792/0 2024-09-11T02:01:13.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 10 monclient(hunting): picked mon.noname-h con 0x7f9a1813f620 addr v1:172.21.15.203:6791/0 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a18138760 con 0x7f9a18138960 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a180a5050 con 0x7f9a1813f620 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1813c750 con 0x7f9a18139450 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a1e1d3640 10 monclient(hunting): authenticate will time out at 915.130725s 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a177fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f9a18138960 0x7f9a18138050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43168/0 (socket says 172.21.15.73:43168) 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a177fe640 1 -- 172.21.15.73:0/184484952 learned_addr learned my addr 172.21.15.73:0/184484952 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102940645 0 0) 0x7f9a18138760 con 0x7f9a18138960 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a0ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a0ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a0ffff640 10 monclient(hunting): my global_id is 5197 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.526+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99f8003520 con 0x7f9a18138960 2024-09-11T02:01:13.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860871843 0 0) 0x7f9a1813c750 con 0x7f9a18139450 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): my global_id is 5218 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a18138760 con 0x7f9a18139450 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362296115 0 0) 0x7f9a180a5050 con 0x7f9a1813f620 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): my global_id is 5378 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a1813c750 con 0x7f9a1813f620 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 58608173 0 0) 0x7f99f8003520 con 0x7f9a18138960 2024-09-11T02:01:13.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a180a5050 con 0x7f9a18138960 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a08001bf0 con 0x7f9a18138960 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): dump: 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.545 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1440716744 0 0) 0x7f9a180a5050 con 0x7f9a18138960 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 >> v1:172.21.15.203:6792/0 conn(0x7f9a18139450 legacy=0x7f9a181d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 >> v1:172.21.15.203:6791/0 conn(0x7f9a1813f620 legacy=0x7f9a181d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 monclient: found mon.c 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1813e940 con 0x7f9a18138960 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a1e1d3640 5 monclient: authenticate success, global_id 5197 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a1e1d3640 10 monclient: _renew_subs 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a1e1d3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1813eeb0 con 0x7f9a18138960 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a1e1d3640 10 monclient: _renew_subs 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a1e1d3640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a1813b230 con 0x7f9a18138960 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a080038c0 con 0x7f9a18138960 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a08003df0 con 0x7f9a18138960 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a15ffb640 4 set_mon_vals no callback set 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.527+0000 7f9a0ffff640 10 monclient: dump: 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.548 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a1e1d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f99fc0065c0 con 0x7f99fc002860 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9a08003f90 con 0x7f9a18138960 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(121..121 src has 1..121) ==== 3506+0+0 (unknown 3091721711 0 0) 0x7f9a0804e340 con 0x7f9a18138960 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078004412 0 0) 0x7f99fc0065c0 con 0x7f99fc002860 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 10 monclient(hunting): my global_id is 114380 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a180a5050 con 0x7f99fc002860 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a17fff640 10 monclient: get_auth_request con 0x7f99f803ffe0 auth_method 0 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3704984329 0 0) 0x7f9a180a5050 con 0x7f99fc002860 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99fc0065c0 con 0x7f99fc002860 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a00001930 con 0x7f99fc002860 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.528+0000 7f9a0ffff640 10 monclient: dump: 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.550 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.529+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1411802853 0 0) 0x7f99fc0065c0 con 0x7f99fc002860 2024-09-11T02:01:13.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.529+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99fc00a160 con 0x7f99fc002860 2024-09-11T02:01:13.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.529+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9a00001d00 con 0x7f99fc002860 2024-09-11T02:01:13.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.529+0000 7f9a0ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.529+0000 7f9a0ffff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:01:13.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.529+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 >> v1:172.21.15.73:6793/0 conn(0x7f99fc002860 legacy=0x7f99fc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.529+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 >> v1:172.21.15.73:6793/0 conn(0x7f99fc002860 legacy=0x7f99fc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a1e1d3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f99fc009e00 con 0x7f99fc0090e0 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616992397 0 0) 0x7f99fc009e00 con 0x7f99fc0090e0 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 10 monclient(hunting): my global_id is 114389 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99fc0065c0 con 0x7f99fc0090e0 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 421355211 0 0) 0x7f99fc0065c0 con 0x7f99fc0090e0 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99fc009e00 con 0x7f99fc0090e0 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9a00003bc0 con 0x7f99fc0090e0 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:01:13.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 10 monclient: dump: 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.555 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2605676513 0 0) 0x7f99fc009e00 con 0x7f99fc0090e0 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.535+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 --> v1:172.21.15.73:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f99fc00c3a0 con 0x7f99fc0090e0 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7699 (unknown 0 0 3469348351) 0x7f9a00005130 con 0x7f99fc0090e0 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a0ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a0ffff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 >> v1:172.21.15.73:6793/0 conn(0x7f99fc0090e0 legacy=0x7f99fc009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a0ffff640 1 -- 172.21.15.73:0/184484952 >> v1:172.21.15.73:6793/0 conn(0x7f99fc0090e0 legacy=0x7f99fc009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.556 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 38, 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 40125, 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:01:13.557 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.558 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.559 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.560 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.561 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.562 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.563 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.565 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.567 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:01:13.568 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.571 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:01:13.572 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.573 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.574 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.575 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:01:13.576 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:01:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 >> v1:172.21.15.203:6812/2311533528 conn(0x7f99f803ffe0 legacy=0x7f99f80424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a1e1d3640 10 monclient: shutdown 2024-09-11T02:01:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a1e1d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 >> v1:172.21.15.73:6791/0 conn(0x7f9a18138960 legacy=0x7f9a18138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a17fff640 1 -- 172.21.15.73:0/184484952 reap_dead start 2024-09-11T02:01:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a17fff640 1 -- 172.21.15.73:0/184484952 reap_dead start 2024-09-11T02:01:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 shutdown_connections 2024-09-11T02:01:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 >> 172.21.15.73:0/184484952 conn(0x7f9a180a8050 msgr2=0x7f9a180a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 shutdown_connections 2024-09-11T02:01:13.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.536+0000 7f9a1e1d3640 1 -- 172.21.15.73:0/184484952 wait complete. 2024-09-11T02:01:13.579 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-11T02:01:13.579 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-09-11T02:01:13.579 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-11T02:01:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.676+0000 7f67435a0640 10 monclient: get_monmap_and_config 2024-09-11T02:01:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.676+0000 7f67435a0640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.676+0000 7f67435a0640 10 monclient: monmap: 2024-09-11T02:01:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:01:13.677577+0000 2024-09-11T02:01:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:01:13.677577+0000 2024-09-11T02:01:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.679 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.677+0000 7f67435a0640 1 Processor -- start 2024-09-11T02:01:13.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.677+0000 7f67435a0640 1 -- start start 2024-09-11T02:01:13.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.677+0000 7f67435a0640 10 monclient: init 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.677+0000 7f67435a0640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.677+0000 7f67435a0640 10 monclient: _add_conns ranks=[7,3,8,4,0,1,2,6,5] 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.677+0000 7f67435a0640 10 monclient(hunting): picked mon.noname-i con 0x7f673c138d40 addr v1:172.21.15.203:6792/0 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 10 monclient(hunting): picked mon.noname-g con 0x7f673c0a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 10 monclient(hunting): picked mon.noname-e con 0x7f673c13f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673c09ca00 con 0x7f673c0a72f0 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673c0a7070 con 0x7f673c138d40 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673c09cee0 con 0x7f673c13f350 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 10 monclient(hunting): authenticate will time out at 915.282104s 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6741b3d640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f673c13f350 0x7f673c141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:39712/0 (socket says 172.21.15.73:39712) 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6741b3d640 1 -- 172.21.15.73:0/3944082070 learned_addr learned my addr 172.21.15.73:0/3944082070 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788441675 0 0) 0x7f673c09cee0 con 0x7f673c13f350 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): my global_id is 114398 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6728003520 con 0x7f673c13f350 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852336025 0 0) 0x7f673c09ca00 con 0x7f673c0a72f0 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): my global_id is 5304 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f673c09cee0 con 0x7f673c0a72f0 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039928151 0 0) 0x7f673c0a7070 con 0x7f673c138d40 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient(hunting): my global_id is 5227 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f673c09ca00 con 0x7f673c138d40 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 281956013 0 0) 0x7f6728003520 con 0x7f673c13f350 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 >> v1:172.21.15.203:6792/0 conn(0x7f673c138d40 legacy=0x7f673c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 >> v1:172.21.15.203:6790/0 conn(0x7f673c0a72f0 legacy=0x7f673c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 monclient: found mon.noname-e 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673c09d1c0 con 0x7f673c13f350 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 5 monclient: authenticate success, global_id 114398 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6734001b30 con 0x7f673c13f350 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: dump: 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.692 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6734001cd0 con 0x7f673c13f350 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 10 monclient: get_monmap_and_config success 2024-09-11T02:01:13.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 1 -- 172.21.15.73:0/3944082070 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6734004f60 con 0x7f673c13f350 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f67435a0640 4 set_mon_vals no callback set 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.678+0000 7f6733fff640 10 monclient: dump: 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.694 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.679+0000 7f67435a0640 10 monclient: shutdown 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.679+0000 7f67435a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.679+0000 7f67435a0640 1 -- 172.21.15.73:0/3944082070 >> v1:172.21.15.73:6793/0 conn(0x7f673c13f350 legacy=0x7f673c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.679+0000 7f67435a0640 1 -- 172.21.15.73:0/3944082070 shutdown_connections 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.679+0000 7f67435a0640 1 -- 172.21.15.73:0/3944082070 >> 172.21.15.73:0/3944082070 conn(0x7f673c0a8050 msgr2=0x7f673c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.679+0000 7f67435a0640 1 -- 172.21.15.73:0/3944082070 shutdown_connections 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.679+0000 7f67435a0640 1 -- 172.21.15.73:0/3944082070 wait complete. 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.679+0000 7f67435a0640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.679+0000 7f67435a0640 10 monclient: monmap: 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.696 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 1 Processor -- start 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 1 -- start start 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 10 monclient: init 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 10 monclient: _add_conns ranks=[1,4,7,8,0,3,5,6,2] 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 10 monclient(hunting): picked mon.noname-f con 0x7f673c0a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 10 monclient(hunting): picked mon.noname-c con 0x7f673c138d40 addr v1:172.21.15.73:6791/0 2024-09-11T02:01:13.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 10 monclient(hunting): picked mon.noname-i con 0x7f673c13f350 addr v1:172.21.15.203:6792/0 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673c13cc50 con 0x7f673c0a72f0 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673c13a800 con 0x7f673c138d40 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673c13eac0 con 0x7f673c13f350 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f67435a0640 10 monclient(hunting): authenticate will time out at 915.284813s 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f6740b3b640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f673c138d40 0x7f673c13a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43176/0 (socket says 172.21.15.73:43176) 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.680+0000 7f6740b3b640 1 -- 172.21.15.73:0/4148774692 learned_addr learned my addr 172.21.15.73:0/4148774692 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323850983 0 0) 0x7f673c13a800 con 0x7f673c138d40 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): my global_id is 5206 2024-09-11T02:01:13.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6720003520 con 0x7f673c138d40 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635616755 0 0) 0x7f673c13cc50 con 0x7f673c0a72f0 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): my global_id is 5140 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f673c13a800 con 0x7f673c0a72f0 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3088779566 0 0) 0x7f673c13eac0 con 0x7f673c13f350 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): my global_id is 5236 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f673c13cc50 con 0x7f673c13f350 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3897239293 0 0) 0x7f6720003520 con 0x7f673c138d40 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f673c13eac0 con 0x7f673c138d40 2024-09-11T02:01:13.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f672c001b90 con 0x7f673c138d40 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): dump: 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.700 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 113460247 0 0) 0x7f673c13a800 con 0x7f673c0a72f0 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6720003520 con 0x7f673c0a72f0 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2147971388 0 0) 0x7f673c13eac0 con 0x7f673c138d40 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 >> v1:172.21.15.203:6792/0 conn(0x7f673c13f350 legacy=0x7f673c1d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 >> v1:172.21.15.203:6789/0 conn(0x7f673c0a72f0 legacy=0x7f673c1399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 monclient: found mon.c 2024-09-11T02:01:13.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673c13b730 con 0x7f673c138d40 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f67435a0640 5 monclient: authenticate success, global_id 5206 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f67435a0640 10 monclient: _renew_subs 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f67435a0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f673c13c970 con 0x7f673c138d40 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f672c0038c0 con 0x7f673c138d40 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f672c003e30 con 0x7f673c138d40 2024-09-11T02:01:13.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f6731ffb640 10 monclient: dump: 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f67435a0640 10 monclient: _renew_subs 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f67337fe640 4 set_mon_vals no callback set 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f67435a0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.681+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f673c0a1630 con 0x7f673c138d40 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f672c004050 con 0x7f673c138d40 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f67435a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f673c0008d0 con 0x7f673c0a2d90 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(121..121 src has 1..121) ==== 3506+0+0 (unknown 3091721711 0 0) 0x7f672c04e2c0 con 0x7f673c138d40 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f6741b3d640 10 monclient: get_auth_request con 0x7f6720040070 auth_method 0 2024-09-11T02:01:13.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523889392 0 0) 0x7f673c0008d0 con 0x7f673c0a2d90 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f6731ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f6731ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f6731ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f6731ffb640 10 monclient(hunting): my global_id is 5149 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.682+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f673c13eac0 con 0x7f673c0a2d90 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2168033751 0 0) 0x7f673c13eac0 con 0x7f673c0a2d90 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f673c0008d0 con 0x7f673c0a2d90 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6738003950 con 0x7f673c0a2d90 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 10 monclient: dump: 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1145715819 0 0) 0x7f673c0008d0 con 0x7f673c0a2d90 2024-09-11T02:01:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f673c0a1910 con 0x7f673c0a2d90 2024-09-11T02:01:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6738004eb0 con 0x7f673c0a2d90 2024-09-11T02:01:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:01:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 >> v1:172.21.15.203:6789/0 conn(0x7f673c0a2d90 legacy=0x7f673c0a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.683+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 >> v1:172.21.15.203:6789/0 conn(0x7f673c0a2d90 legacy=0x7f673c0a3170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.689+0000 7f67435a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.689+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f673c0a3c60 con 0x7f673c0a3880 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615932515 0 0) 0x7f673c0a3c60 con 0x7f673c0a3880 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 10 monclient(hunting): my global_id is 5158 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f673c0008d0 con 0x7f673c0a3880 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 438330149 0 0) 0x7f673c0008d0 con 0x7f673c0a3880 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f673c0a3c60 con 0x7f673c0a3880 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f67380056d0 con 0x7f673c0a3880 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 10 monclient: dump: 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4022876514 0 0) 0x7f673c0a3c60 con 0x7f673c0a3880 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.690+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 --> v1:172.21.15.203:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f673c0a1ac0 con 0x7f673c0a3880 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7702 (unknown 0 0 2354469800) 0x7f6738005740 con 0x7f673c0a3880 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f6731ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f6731ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 >> v1:172.21.15.203:6789/0 conn(0x7f673c0a3880 legacy=0x7f673c1db4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f6731ffb640 1 -- 172.21.15.73:0/4148774692 >> v1:172.21.15.203:6789/0 conn(0x7f673c0a3880 legacy=0x7f673c1db4e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.711 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 38, 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 196107, 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:01:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.713 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.714 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.715 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.716 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:01:13.717 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.719 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.720 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:01:13.721 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.722 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.723 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:01:13.724 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.725 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.727 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.728 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.729 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.730 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.731 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:01:13.731 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:01:13.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 >> v1:172.21.15.203:6812/2311533528 conn(0x7f6720040070 legacy=0x7f6720042530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f67435a0640 10 monclient: shutdown 2024-09-11T02:01:13.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f67435a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 >> v1:172.21.15.73:6791/0 conn(0x7f673c138d40 legacy=0x7f673c13a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f6741b3d640 1 -- 172.21.15.73:0/4148774692 reap_dead start 2024-09-11T02:01:13.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f6741b3d640 1 -- 172.21.15.73:0/4148774692 reap_dead start 2024-09-11T02:01:13.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 shutdown_connections 2024-09-11T02:01:13.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 >> 172.21.15.73:0/4148774692 conn(0x7f673c0a8050 msgr2=0x7f673c0a4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 shutdown_connections 2024-09-11T02:01:13.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.691+0000 7f67435a0640 1 -- 172.21.15.73:0/4148774692 wait complete. 2024-09-11T02:01:13.733 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-11T02:01:13.733 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-09-11T02:01:13.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-11T02:01:13.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.830+0000 7fbbed4e6640 10 monclient: get_monmap_and_config 2024-09-11T02:01:13.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.830+0000 7fbbed4e6640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.830+0000 7fbbed4e6640 10 monclient: monmap: 2024-09-11T02:01:13.832 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.832 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:01:13.831773+0000 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:01:13.831773+0000 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.833 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.831+0000 7fbbed4e6640 1 Processor -- start 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.831+0000 7fbbed4e6640 1 -- start start 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.831+0000 7fbbed4e6640 10 monclient: init 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.831+0000 7fbbed4e6640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 10 monclient: _add_conns ranks=[1,8,6,4,2,3,5,0,7] 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 10 monclient(hunting): picked mon.noname-f con 0x7fbbe8138d40 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 10 monclient(hunting): picked mon.noname-e con 0x7fbbe80a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 10 monclient(hunting): picked mon.noname-d con 0x7fbbe813f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe809ca00 con 0x7fbbe8138d40 2024-09-11T02:01:13.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe80a7070 con 0x7fbbe813f350 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe809cee0 con 0x7fbbe80a72f0 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 10 monclient(hunting): authenticate will time out at 915.436114s 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe67fc640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fbbe80a72f0 0x7fbbe813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:39716/0 (socket says 172.21.15.73:39716) 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe67fc640 1 -- 172.21.15.73:0/2585361300 learned_addr learned my addr 172.21.15.73:0/2585361300 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547050514 0 0) 0x7fbbe809cee0 con 0x7fbbe80a72f0 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient(hunting): my global_id is 114407 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbd4003520 con 0x7fbbe80a72f0 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965562348 0 0) 0x7fbbe80a7070 con 0x7fbbe813f350 2024-09-11T02:01:13.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient(hunting): my global_id is 114369 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbe809cee0 con 0x7fbbe813f350 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 736013164 0 0) 0x7fbbd4003520 con 0x7fbbe80a72f0 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 >> v1:172.21.15.73:6792/0 conn(0x7fbbe813f350 legacy=0x7fbbe8141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 >> v1:172.21.15.203:6789/0 conn(0x7fbbe8138d40 legacy=0x7fbbe8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 monclient: found mon.noname-e 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe809d1c0 con 0x7fbbe80a72f0 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 5 monclient: authenticate success, global_id 114407 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbbd0001830 con 0x7fbbe80a72f0 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: dump: 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.845 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbbd0001a50 con 0x7fbbe80a72f0 2024-09-11T02:01:13.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 10 monclient: get_monmap_and_config success 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 1 -- 172.21.15.73:0/2585361300 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbbd0004be0 con 0x7fbbe80a72f0 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbed4e6640 4 set_mon_vals no callback set 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.832+0000 7fbbe5ffb640 10 monclient: dump: 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.847 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.833+0000 7fbbed4e6640 10 monclient: shutdown 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.833+0000 7fbbed4e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.833+0000 7fbbed4e6640 1 -- 172.21.15.73:0/2585361300 >> v1:172.21.15.73:6793/0 conn(0x7fbbe80a72f0 legacy=0x7fbbe813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.833+0000 7fbbed4e6640 1 -- 172.21.15.73:0/2585361300 shutdown_connections 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.833+0000 7fbbed4e6640 1 -- 172.21.15.73:0/2585361300 >> 172.21.15.73:0/2585361300 conn(0x7fbbe80a8050 msgr2=0x7fbbe80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.833+0000 7fbbed4e6640 1 -- 172.21.15.73:0/2585361300 shutdown_connections 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.833+0000 7fbbed4e6640 1 -- 172.21.15.73:0/2585361300 wait complete. 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.833+0000 7fbbed4e6640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.833+0000 7fbbed4e6640 10 monclient: monmap: 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:01:13.849 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 1 Processor -- start 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 1 -- start start 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 10 monclient: init 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 10 monclient: _add_conns ranks=[2,6,0,5,1,8,7,4,3] 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 10 monclient(hunting): picked mon.noname-b con 0x7fbbe80a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 10 monclient(hunting): picked mon.noname-d con 0x7fbbe8138d40 addr v1:172.21.15.73:6792/0 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 10 monclient(hunting): picked mon.noname-a con 0x7fbbe813f350 addr v1:172.21.15.73:6789/0 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe813ea70 con 0x7fbbe813f350 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe80a1960 con 0x7fbbe80a72f0 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbe6ffd640 1 -- >> v1:172.21.15.73:6790/0 conn(0x7fbbe80a72f0 legacy=0x7fbbe81399e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe81387f0 con 0x7fbbe8138d40 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbed4e6640 10 monclient(hunting): authenticate will time out at 915.438939s 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.834+0000 7fbbe67fc640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fbbe8138d40 0x7fbbe813a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:58082/0 (socket says 172.21.15.73:58082) 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbe67fc640 1 -- 172.21.15.73:0/3887490855 learned_addr learned my addr 172.21.15.73:0/3887490855 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121939106 0 0) 0x7fbbe81387f0 con 0x7fbbe8138d40 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): my global_id is 114378 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc8003520 con 0x7fbbe8138d40 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3934035321 0 0) 0x7fbbe813ea70 con 0x7fbbe813f350 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): my global_id is 5418 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbe81387f0 con 0x7fbbe813f350 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1361419774 0 0) 0x7fbbc8003520 con 0x7fbbe8138d40 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbe813ea70 con 0x7fbbe8138d40 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbbd0004b20 con 0x7fbbe8138d40 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): dump: 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.853 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1219125328 0 0) 0x7fbbe81387f0 con 0x7fbbe813f350 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbc8003520 con 0x7fbbe813f350 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbbe0001a50 con 0x7fbbe813f350 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient(hunting): dump: 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2207139830 0 0) 0x7fbbe813ea70 con 0x7fbbe8138d40 2024-09-11T02:01:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 >> v1:172.21.15.73:6790/0 conn(0x7fbbe80a72f0 legacy=0x7fbbe81399e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 >> v1:172.21.15.73:6789/0 conn(0x7fbbe813f350 legacy=0x7fbbe81d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 monclient: found mon.d 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe813c660 con 0x7fbbe8138d40 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbed4e6640 5 monclient: authenticate success, global_id 114378 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbed4e6640 10 monclient: _renew_subs 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbed4e6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:01:13.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe813a800 con 0x7fbbe8138d40 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbed4e6640 10 monclient: _renew_subs 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbed4e6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbbe813b140 con 0x7fbbe8138d40 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbbd00011f0 con 0x7fbbe8138d40 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbbd0001950 con 0x7fbbe8138d40 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbe57fa640 4 set_mon_vals no callback set 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.835+0000 7fbbdf7fe640 10 monclient: dump: 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.857 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.836+0000 7fbbed4e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.836+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbbcc0065c0 con 0x7fbbcc002860 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.836+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fbbd0011780 con 0x7fbbe8138d40 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.836+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(122..122 src has 1..122) ==== 3898+0+0 (unknown 3671545047 0 0) 0x7fbbd004e510 con 0x7fbbe8138d40 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbe77fe640 10 monclient: get_auth_request con 0x7fbbc8040240 auth_method 0 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512199341 0 0) 0x7fbbcc0065c0 con 0x7fbbcc002860 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 10 monclient(hunting): my global_id is 5313 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbe813ea70 con 0x7fbbcc002860 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1971644328 0 0) 0x7fbbe813ea70 con 0x7fbbcc002860 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbcc0065c0 con 0x7fbbcc002860 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbbd8001ce0 con 0x7fbbcc002860 2024-09-11T02:01:13.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 10 monclient: dump: 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.860 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 64116391 0 0) 0x7fbbcc0065c0 con 0x7fbbcc002860 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.203:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbbcc00a160 con 0x7fbbcc002860 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbbd8005b40 con 0x7fbbcc002860 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 >> v1:172.21.15.203:6790/0 conn(0x7fbbcc002860 legacy=0x7fbbcc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.837+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 >> v1:172.21.15.203:6790/0 conn(0x7fbbcc002860 legacy=0x7fbbcc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.843+0000 7fbbed4e6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:01:13.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbbcc009e70 con 0x7fbbcc009130 2024-09-11T02:01:13.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874638234 0 0) 0x7fbbcc009e70 con 0x7fbbcc009130 2024-09-11T02:01:13.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 10 monclient(hunting): my global_id is 5322 2024-09-11T02:01:13.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbcc0065c0 con 0x7fbbcc009130 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2283017682 0 0) 0x7fbbcc0065c0 con 0x7fbbcc009130 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbcc009e70 con 0x7fbbcc009130 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fbbd80020c0 con 0x7fbbcc009130 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 10 monclient: dump: 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:13.864 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1513058227 0 0) 0x7fbbcc009e70 con 0x7fbbcc009130 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.844+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 --> v1:172.21.15.203:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbbcc00c410 con 0x7fbbcc009130 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7700 (unknown 0 0 3266762460) 0x7fbbd8003fe0 con 0x7fbbcc009130 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbdf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbdf7fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:01:13.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 >> v1:172.21.15.203:6790/0 conn(0x7fbbcc009130 legacy=0x7fbbcc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbdf7fe640 1 -- 172.21.15.73:0/3887490855 >> v1:172.21.15.203:6790/0 conn(0x7fbbcc009130 legacy=0x7fbbcc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 38, 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 196283, 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:01:13.866 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.867 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.868 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:01:13.869 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:13.870 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.871 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:01:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:01:13.873 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.874 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.877 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:01:13.878 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.879 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.880 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.881 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.882 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.884 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:13.885 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-09-11T02:01:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:13.886 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:01:13.886 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:01:13.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 >> v1:172.21.15.203:6812/2311533528 conn(0x7fbbc8040240 legacy=0x7fbbc8042700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbed4e6640 10 monclient: shutdown 2024-09-11T02:01:13.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbed4e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:13.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 >> v1:172.21.15.73:6792/0 conn(0x7fbbe8138d40 legacy=0x7fbbe813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbe77fe640 1 -- 172.21.15.73:0/3887490855 reap_dead start 2024-09-11T02:01:13.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbe77fe640 1 -- 172.21.15.73:0/3887490855 reap_dead start 2024-09-11T02:01:13.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 shutdown_connections 2024-09-11T02:01:13.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 >> 172.21.15.73:0/3887490855 conn(0x7fbbe80a8050 msgr2=0x7fbbe813ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:13.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 shutdown_connections 2024-09-11T02:01:13.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.845+0000 7fbbed4e6640 1 -- 172.21.15.73:0/3887490855 wait complete. 2024-09-11T02:01:13.888 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-11T02:01:13.888 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-09-11T02:01:13.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-11T02:01:13.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.985+0000 7fee8c423640 10 monclient: get_monmap_and_config 2024-09-11T02:01:13.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.985+0000 7fee8c423640 10 monclient: build_initial_monmap 2024-09-11T02:01:13.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.985+0000 7fee8c423640 10 monclient: monmap: 2024-09-11T02:01:13.987 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:13.987 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:13.987 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:01:13.986525+0000 2024-09-11T02:01:13.987 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:01:13.986525+0000 2024-09-11T02:01:13.987 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:13.988 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 1 Processor -- start 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 1 -- start start 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 10 monclient: init 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 10 monclient: _add_conns ranks=[8,2,1,0,3,4,6,7,5] 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 10 monclient(hunting): picked mon.noname-e con 0x7fee84138e40 addr v1:172.21.15.73:6793/0 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 10 monclient(hunting): picked mon.noname-b con 0x7fee84139220 addr v1:172.21.15.73:6790/0 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 10 monclient(hunting): picked mon.noname-f con 0x7fee8413f250 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee8409d190 con 0x7fee8413f250 2024-09-11T02:01:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee8409e280 con 0x7fee84139220 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee8409ceb0 con 0x7fee84138e40 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee8c423640 10 monclient(hunting): authenticate will time out at 915.590977s 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.986+0000 7fee899be640 1 -- >> v1:172.21.15.73:6790/0 conn(0x7fee84139220 legacy=0x7fee8413db30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee8a1bf640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fee84138e40 0x7fee8409db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:39718/0 (socket says 172.21.15.73:39718) 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee8a1bf640 1 -- 172.21.15.73:0/234274810 learned_addr learned my addr 172.21.15.73:0/234274810 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 -- 172.21.15.73:0/234274810 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393505569 0 0) 0x7fee8409ceb0 con 0x7fee84138e40 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient(hunting): my global_id is 114416 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 -- 172.21.15.73:0/234274810 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee70003520 con 0x7fee84138e40 2024-09-11T02:01:13.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 -- 172.21.15.73:0/234274810 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2422658164 0 0) 0x7fee70003520 con 0x7fee84138e40 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 -- 172.21.15.73:0/234274810 >> v1:172.21.15.73:6790/0 conn(0x7fee84139220 legacy=0x7fee8413db30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 -- 172.21.15.73:0/234274810 >> v1:172.21.15.203:6789/0 conn(0x7fee8413f250 legacy=0x7fee84141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: _finish_hunting 0 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 monclient: found mon.noname-e 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 -- 172.21.15.73:0/234274810 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8409d470 con 0x7fee84138e40 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: _finish_auth 0 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: _check_auth_tickets 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 -- 172.21.15.73:0/234274810 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fee80001830 con 0x7fee84138e40 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee8c423640 5 monclient: authenticate success, global_id 114416 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee8c423640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: dump: 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee8c423640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 -- 172.21.15.73:0/234274810 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee80001a50 con 0x7fee84138e40 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee8c423640 10 monclient: get_monmap_and_config success 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee8c423640 4 set_mon_vals no callback set 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 1 -- 172.21.15.73:0/234274810 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fee80004be0 con 0x7fee84138e40 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.987+0000 7fee891bd640 10 monclient: dump: 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.988+0000 7fee8c423640 10 monclient: shutdown 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.988+0000 7fee8c423640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.988+0000 7fee8c423640 1 -- 172.21.15.73:0/234274810 >> v1:172.21.15.73:6793/0 conn(0x7fee84138e40 legacy=0x7fee8409db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.988+0000 7fee8c423640 1 -- 172.21.15.73:0/234274810 shutdown_connections 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.988+0000 7fee8c423640 1 -- 172.21.15.73:0/234274810 >> 172.21.15.73:0/234274810 conn(0x7fee840abe10 msgr2=0x7fee840a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.988+0000 7fee8c423640 1 -- 172.21.15.73:0/234274810 shutdown_connections 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.988+0000 7fee8c423640 1 -- 172.21.15.73:0/234274810 wait complete. 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.988+0000 7fee8c423640 10 monclient: build_initial_monmap 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.988+0000 7fee8c423640 10 monclient: monmap: 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 1 Processor -- start 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 1 -- start start 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 10 monclient: init 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 10 monclient: _add_conns ranks=[2,6,1,7,5,3,8,0,4] 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 10 monclient(hunting): picked mon.noname-b con 0x7fee84138e40 addr v1:172.21.15.73:6790/0 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 10 monclient(hunting): picked mon.noname-d con 0x7fee84139220 addr v1:172.21.15.73:6792/0 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 10 monclient(hunting): picked mon.noname-f con 0x7fee8413f250 addr v1:172.21.15.203:6789/0 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8a1bf640 1 -- >> v1:172.21.15.73:6790/0 conn(0x7fee84138e40 legacy=0x7fee8409efc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.73:6790/0 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee840a09f0 con 0x7fee8413f250 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee840a35e0 con 0x7fee84138e40 2024-09-11T02:01:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee840a3300 con 0x7fee84139220 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee8c423640 10 monclient(hunting): authenticate will time out at 915.593685s 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee899be640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fee84139220 0x7fee8409f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:58094/0 (socket says 172.21.15.73:58094) 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee899be640 1 -- 172.21.15.73:0/1629077363 learned_addr learned my addr 172.21.15.73:0/1629077363 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123509084 0 0) 0x7fee840a3300 con 0x7fee84139220 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee7affd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee7affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee7affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee7affd640 10 monclient(hunting): my global_id is 114387 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.989+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee68003550 con 0x7fee84139220 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283015096 0 0) 0x7fee840a09f0 con 0x7fee8413f250 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient(hunting): my global_id is 5185 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee840a3300 con 0x7fee8413f250 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 473677882 0 0) 0x7fee68003550 con 0x7fee84139220 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee840a09f0 con 0x7fee84139220 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fee74004370 con 0x7fee84139220 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient(hunting): dump: 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3422872780 0 0) 0x7fee840a09f0 con 0x7fee84139220 2024-09-11T02:01:14.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 >> v1:172.21.15.73:6790/0 conn(0x7fee84138e40 legacy=0x7fee8409efc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 >> v1:172.21.15.203:6789/0 conn(0x7fee8413f250 legacy=0x7fee8409fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient: _finish_hunting 0 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 monclient: found mon.d 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee840a12d0 con 0x7fee84139220 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient: _finish_auth 0 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient: _check_auth_tickets 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee8c423640 5 monclient: authenticate success, global_id 114387 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee8c423640 10 monclient: _renew_subs 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee8c423640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:01:14.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fee841364f0 con 0x7fee84139220 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee8c423640 10 monclient: _renew_subs 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee8c423640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fee841d6e90 con 0x7fee84139220 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee74004590 con 0x7fee84139220 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fee74004b00 con 0x7fee84139220 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee889bc640 4 set_mon_vals no callback set 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.990+0000 7fee7affd640 10 monclient: dump: 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.010 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee8c423640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fee6c0065c0 con 0x7fee6c002860 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fee74004d20 con 0x7fee84139220 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(122..122 src has 1..122) ==== 3898+0+0 (unknown 3671545047 0 0) 0x7fee7404e4f0 con 0x7fee84139220 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee8a9c0640 10 monclient: get_auth_request con 0x7fee6803fd40 auth_method 0 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3536197894 0 0) 0x7fee6c0065c0 con 0x7fee6c002860 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee7affd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee7affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee7affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee7affd640 10 monclient(hunting): my global_id is 5387 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee840a09f0 con 0x7fee6c002860 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.991+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4134474185 0 0) 0x7fee840a09f0 con 0x7fee6c002860 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee6c0065c0 con 0x7fee6c002860 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fee80004be0 con 0x7fee6c002860 2024-09-11T02:01:14.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 10 monclient: dump: 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1987878530 0 0) 0x7fee6c0065c0 con 0x7fee6c002860 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.203:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee6c00a160 con 0x7fee6c002860 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fee800014b0 con 0x7fee6c002860 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 >> v1:172.21.15.203:6791/0 conn(0x7fee6c002860 legacy=0x7fee6c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.992+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 >> v1:172.21.15.203:6791/0 conn(0x7fee6c002860 legacy=0x7fee6c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.998+0000 7fee8c423640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.998+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fee6c009e50 con 0x7fee6c009110 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309967384 0 0) 0x7fee6c009e50 con 0x7fee6c009110 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 10 monclient(hunting): my global_id is 5396 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6c0065c0 con 0x7fee6c009110 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2578395442 0 0) 0x7fee6c0065c0 con 0x7fee6c009110 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee6c009e50 con 0x7fee6c009110 2024-09-11T02:01:14.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fee800018d0 con 0x7fee6c009110 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 10 monclient: dump: 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.017 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1617143230 0 0) 0x7fee6c009e50 con 0x7fee6c009110 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 --> v1:172.21.15.203:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fee6c00c3f0 con 0x7fee6c009110 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7533 (unknown 0 0 219600378) 0x7fee80005340 con 0x7fee6c009110 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 >> v1:172.21.15.203:6791/0 conn(0x7fee6c009110 legacy=0x7fee6c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:13.999+0000 7fee7affd640 1 -- 172.21.15.73:0/1629077363 >> v1:172.21.15.203:6791/0 conn(0x7fee6c009110 legacy=0x7fee6c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 38, 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 196436, 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:01:14.019 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:14.020 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:14.021 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:01:14.022 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:14.023 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:14.024 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.025 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.026 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:01:14.026 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:01:14.026 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.026 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.026 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.027 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.028 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:01:14.029 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.030 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.032 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:01:14.033 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.034 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.035 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.036 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:14.038 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:14.039 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:01:14.039 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.039 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.039 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:01:14.039 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:01:14.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 >> v1:172.21.15.203:6812/2311533528 conn(0x7fee6803fd40 legacy=0x7fee68042200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8c423640 10 monclient: shutdown 2024-09-11T02:01:14.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8c423640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:14.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 >> v1:172.21.15.73:6792/0 conn(0x7fee84139220 legacy=0x7fee8409f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8a9c0640 1 -- 172.21.15.73:0/1629077363 reap_dead start 2024-09-11T02:01:14.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8a9c0640 1 -- 172.21.15.73:0/1629077363 reap_dead start 2024-09-11T02:01:14.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 shutdown_connections 2024-09-11T02:01:14.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 >> 172.21.15.73:0/1629077363 conn(0x7fee840abe10 msgr2=0x7fee8412fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:14.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 shutdown_connections 2024-09-11T02:01:14.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.000+0000 7fee8c423640 1 -- 172.21.15.73:0/1629077363 wait complete. 2024-09-11T02:01:14.041 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-11T02:01:14.041 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-09-11T02:01:14.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-11T02:01:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.138+0000 7ff865375640 10 monclient: get_monmap_and_config 2024-09-11T02:01:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.138+0000 7ff865375640 10 monclient: build_initial_monmap 2024-09-11T02:01:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.138+0000 7ff865375640 10 monclient: monmap: 2024-09-11T02:01:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:01:14.139057+0000 2024-09-11T02:01:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:01:14.139057+0000 2024-09-11T02:01:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:14.140 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.138+0000 7ff865375640 1 Processor -- start 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.138+0000 7ff865375640 1 -- start start 2024-09-11T02:01:14.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.138+0000 7ff865375640 10 monclient: init 2024-09-11T02:01:14.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:14.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 10 monclient: _add_conns ranks=[5,7,8,4,1,0,2,6,3] 2024-09-11T02:01:14.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 10 monclient(hunting): picked mon.noname-h con 0x7ff860138960 addr v1:172.21.15.203:6791/0 2024-09-11T02:01:14.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 10 monclient(hunting): picked mon.noname-i con 0x7ff860139450 addr v1:172.21.15.203:6792/0 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 10 monclient(hunting): picked mon.noname-e con 0x7ff86013f620 addr v1:172.21.15.73:6793/0 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86009d030 con 0x7ff860138960 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86009d310 con 0x7ff860139450 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86006f770 con 0x7ff86013f620 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff865375640 10 monclient(hunting): authenticate will time out at 915.743421s 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85f7fe640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7ff86013f620 0x7ff860141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:39728/0 (socket says 172.21.15.73:39728) 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85f7fe640 1 -- 172.21.15.73:0/2135366085 learned_addr learned my addr 172.21.15.73:0/2135366085 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846880167 0 0) 0x7ff86006f770 con 0x7ff86013f620 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient(hunting): my global_id is 114425 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff848003520 con 0x7ff86013f620 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3718732568 0 0) 0x7ff86009d030 con 0x7ff860138960 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient(hunting): my global_id is 5405 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff86006f770 con 0x7ff860138960 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1852129266 0 0) 0x7ff848003520 con 0x7ff86013f620 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 >> v1:172.21.15.203:6792/0 conn(0x7ff860139450 legacy=0x7ff86013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 >> v1:172.21.15.203:6791/0 conn(0x7ff860138960 legacy=0x7ff860138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient: _finish_hunting 0 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 1 monclient: found mon.noname-e 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:14.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8600a7360 con 0x7ff86013f620 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient: _finish_auth 0 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 10 monclient: _check_auth_tickets 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.139+0000 7ff85dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 5 monclient: authenticate success, global_id 114425 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff858001bb0 con 0x7ff86013f620 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 10 monclient: dump: 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.154 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff858001d50 con 0x7ff86013f620 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 1 -- 172.21.15.73:0/2135366085 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff858004f60 con 0x7ff86013f620 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 10 monclient: get_monmap_and_config success 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 4 set_mon_vals no callback set 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff85dffb640 10 monclient: dump: 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 10 monclient: shutdown 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 1 -- 172.21.15.73:0/2135366085 >> v1:172.21.15.73:6793/0 conn(0x7ff86013f620 legacy=0x7ff860141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 1 -- 172.21.15.73:0/2135366085 shutdown_connections 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 1 -- 172.21.15.73:0/2135366085 >> 172.21.15.73:0/2135366085 conn(0x7ff8600a8050 msgr2=0x7ff8600a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 1 -- 172.21.15.73:0/2135366085 shutdown_connections 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.140+0000 7ff865375640 1 -- 172.21.15.73:0/2135366085 wait complete. 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.141+0000 7ff865375640 10 monclient: build_initial_monmap 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.141+0000 7ff865375640 10 monclient: monmap: 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:01:14.158 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.141+0000 7ff865375640 1 Processor -- start 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.141+0000 7ff865375640 1 -- start start 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.141+0000 7ff865375640 10 monclient: init 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 10 monclient: _reopen_session rank -1 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 10 monclient: _add_conns ranks=[4,5,6,2,8,1,0,7,3] 2024-09-11T02:01:14.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 10 monclient(hunting): picked mon.noname-c con 0x7ff860138960 addr v1:172.21.15.73:6791/0 2024-09-11T02:01:14.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 10 monclient(hunting): picked mon.noname-h con 0x7ff860139450 addr v1:172.21.15.203:6791/0 2024-09-11T02:01:14.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 10 monclient(hunting): picked mon.noname-d con 0x7ff86013f620 addr v1:172.21.15.73:6792/0 2024-09-11T02:01:14.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86013ac30 con 0x7ff860138960 2024-09-11T02:01:14.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86013c7d0 con 0x7ff860139450 2024-09-11T02:01:14.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86013cab0 con 0x7ff86013f620 2024-09-11T02:01:14.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 10 monclient(hunting): _renew_subs 2024-09-11T02:01:14.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff865375640 10 monclient(hunting): authenticate will time out at 915.746291s 2024-09-11T02:01:14.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff85effd640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7ff860138960 0x7ff86013dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:43188/0 (socket says 172.21.15.73:43188) 2024-09-11T02:01:14.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff85effd640 1 -- 172.21.15.73:0/2897198467 learned_addr learned my addr 172.21.15.73:0/2897198467 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:01:14.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153017596 0 0) 0x7ff86013cab0 con 0x7ff86013f620 2024-09-11T02:01:14.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): my global_id is 114396 2024-09-11T02:01:14.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff84c003520 con 0x7ff86013f620 2024-09-11T02:01:14.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088866203 0 0) 0x7ff86013ac30 con 0x7ff860138960 2024-09-11T02:01:14.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): my global_id is 5215 2024-09-11T02:01:14.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff86013cab0 con 0x7ff860138960 2024-09-11T02:01:14.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3583403411 0 0) 0x7ff86013c7d0 con 0x7ff860139450 2024-09-11T02:01:14.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): my global_id is 5414 2024-09-11T02:01:14.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff86013ac30 con 0x7ff860139450 2024-09-11T02:01:14.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 96960309 0 0) 0x7ff84c003520 con 0x7ff86013f620 2024-09-11T02:01:14.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff86013c7d0 con 0x7ff86013f620 2024-09-11T02:01:14.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 771578324 0 0) 0x7ff86013cab0 con 0x7ff860138960 2024-09-11T02:01:14.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff84c003520 con 0x7ff860138960 2024-09-11T02:01:14.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff858001af0 con 0x7ff86013f620 2024-09-11T02:01:14.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:14.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:01:14.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): dump: 2024-09-11T02:01:14.165 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.165 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.165 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.165 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.165 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.165 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.165 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.165 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.166 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.166 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.166 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.166 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.166 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.166 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.167 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.167 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:01:14.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff850001b90 con 0x7ff860138960 2024-09-11T02:01:14.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:01:14.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T02:01:14.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 10 monclient(hunting): dump: 2024-09-11T02:01:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1573919923 0 0) 0x7ff86013c7d0 con 0x7ff86013f620 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.142+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 >> v1:172.21.15.203:6791/0 conn(0x7ff860139450 legacy=0x7ff8601d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 >> v1:172.21.15.73:6791/0 conn(0x7ff860138960 legacy=0x7ff86013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 10 monclient: _finish_hunting 0 2024-09-11T02:01:14.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 1 monclient: found mon.d 2024-09-11T02:01:14.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:01:14.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:01:14.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86013b2b0 con 0x7ff86013f620 2024-09-11T02:01:14.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 10 monclient: _finish_auth 0 2024-09-11T02:01:14.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 10 monclient: _check_auth_tickets 2024-09-11T02:01:14.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:01:14.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff865375640 5 monclient: authenticate success, global_id 114396 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff865375640 10 monclient: _renew_subs 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff865375640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8600a51f0 con 0x7ff86013f620 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff865375640 10 monclient: _renew_subs 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff865375640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ff86013a190 con 0x7ff86013f620 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff858004e80 con 0x7ff86013f620 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff858005370 con 0x7ff86013f620 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff85d7fa640 4 set_mon_vals no callback set 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff8477fe640 10 monclient: dump: 2024-09-11T02:01:14.171 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.172 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff865375640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.143+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff8400065c0 con 0x7ff840002860 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7ff858005510 con 0x7ff86013f620 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(122..122 src has 1..122) ==== 3898+0+0 (unknown 3671545047 0 0) 0x7ff85804e570 con 0x7ff86013f620 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906692171 0 0) 0x7ff8400065c0 con 0x7ff840002860 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 10 monclient(hunting): my global_id is 5254 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff86013c7d0 con 0x7ff840002860 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff85e7fc640 10 monclient: get_auth_request con 0x7ff84c040270 auth_method 0 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1821274387 0 0) 0x7ff86013c7d0 con 0x7ff840002860 2024-09-11T02:01:14.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8400065c0 con 0x7ff840002860 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff850003be0 con 0x7ff840002860 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 10 monclient: dump: 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.174 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1951006924 0 0) 0x7ff8400065c0 con 0x7ff840002860 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.144+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.203:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff84000a160 con 0x7ff840002860 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.145+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff850003e00 con 0x7ff840002860 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.145+0000 7ff8477fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.145+0000 7ff8477fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.145+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 >> v1:172.21.15.203:6792/0 conn(0x7ff840002860 legacy=0x7ff840004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.145+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 >> v1:172.21.15.203:6792/0 conn(0x7ff840002860 legacy=0x7ff840004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:14.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff865375640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:01:14.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff840009e00 con 0x7ff8400090e0 2024-09-11T02:01:14.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639976819 0 0) 0x7ff840009e00 con 0x7ff8400090e0 2024-09-11T02:01:14.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 10 monclient(hunting): _negotiate 2024-09-11T02:01:14.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:01:14.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 10 monclient(hunting): my global_id is 5263 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8400065c0 con 0x7ff8400090e0 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1283295963 0 0) 0x7ff8400065c0 con 0x7ff8400090e0 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff840009e00 con 0x7ff8400090e0 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7ff8500057c0 con 0x7ff8400090e0 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.151+0000 7ff8477fe640 10 monclient: dump: 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:01:14.181 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2882152607 0 0) 0x7ff840009e00 con 0x7ff8400090e0 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 --> v1:172.21.15.203:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff84000c3a0 con 0x7ff8400090e0 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7533 (unknown 0 0 2643546487) 0x7ff850007a40 con 0x7ff8400090e0 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff8477fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:01:14.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff8477fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 >> v1:172.21.15.203:6792/0 conn(0x7ff8400090e0 legacy=0x7ff840009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff8477fe640 1 -- 172.21.15.73:0/2897198467 >> v1:172.21.15.203:6792/0 conn(0x7ff8400090e0 legacy=0x7ff840009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 38, 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 196573, 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:01:14.183 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:01:14.184 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:01:14.185 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:01:14.186 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:01:14.187 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:01:14.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:01:14.190 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.191 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:01:14.193 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.194 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.195 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:01:14.196 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.197 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:01:14.198 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.199 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:14.200 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:01:14.201 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 >> v1:172.21.15.203:6812/2311533528 conn(0x7ff84c040270 legacy=0x7ff84c042730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff865375640 10 monclient: shutdown 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff865375640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 >> v1:172.21.15.73:6792/0 conn(0x7ff86013f620 legacy=0x7ff8601d5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff85f7fe640 1 -- 172.21.15.73:0/2897198467 reap_dead start 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff85f7fe640 1 -- 172.21.15.73:0/2897198467 reap_dead start 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 shutdown_connections 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 >> 172.21.15.73:0/2897198467 conn(0x7ff8600a8050 msgr2=0x7ff860141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 shutdown_connections 2024-09-11T02:01:14.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:01:14.152+0000 7ff865375640 1 -- 172.21.15.73:0/2897198467 wait complete. 2024-09-11T02:01:14.204 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-11T02:01:14.204 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-09-11T02:01:14.815 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:14.815 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36602]: starting. 2024-09-11T02:01:14.815 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36602]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36552 2024-09-11T02:01:14.815 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36602]: created object 0... 2024-09-11T02:01:14.815 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36602]: created object 25... 2024-09-11T02:01:14.815 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36602]: created object 49... 2024-09-11T02:01:14.816 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36602]: finishing. 2024-09-11T02:01:14.816 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36602]: shutting down. 2024-09-11T02:01:14.825 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:14.826 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36604]: starting. 2024-09-11T02:01:14.826 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36604]: listing objects. 2024-09-11T02:01:14.826 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36604]: listed object 0... 2024-09-11T02:01:14.826 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36604]: listed object 25... 2024-09-11T02:01:14.826 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36604]: saw 50 objects 2024-09-11T02:01:14.826 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36604]: shutting down. 2024-09-11T02:01:15.745 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:15.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36603]: starting. 2024-09-11T02:01:15.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36603]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36552 2024-09-11T02:01:15.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36603]: shutting down. 2024-09-11T02:01:15.747 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:15.747 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:15.747 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:01:15.750 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:01:17.835 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36673]: starting. 2024-09-11T02:01:17.835 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36673]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36672 2024-09-11T02:01:17.835 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36673]: created object 0... 2024-09-11T02:01:17.835 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36673]: created object 25... 2024-09-11T02:01:17.835 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36673]: created object 49... 2024-09-11T02:01:17.835 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36673]: finishing. 2024-09-11T02:01:17.835 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36673]: shutting down. 2024-09-11T02:01:18.762 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36674]: starting. 2024-09-11T02:01:18.763 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36674]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36672 2024-09-11T02:01:18.763 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36674]: shutting down. 2024-09-11T02:01:20.868 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:20.868 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36709]: starting. 2024-09-11T02:01:20.868 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36709]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36672 2024-09-11T02:01:20.869 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36709]: created object 0... 2024-09-11T02:01:20.869 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36709]: created object 25... 2024-09-11T02:01:20.869 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36709]: created object 49... 2024-09-11T02:01:20.869 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36709]: finishing. 2024-09-11T02:01:20.869 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36709]: shutting down. 2024-09-11T02:01:20.879 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:20.879 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36711]: starting. 2024-09-11T02:01:20.879 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36711]: listing objects. 2024-09-11T02:01:20.879 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36711]: listed object 0... 2024-09-11T02:01:20.879 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36711]: listed object 25... 2024-09-11T02:01:20.880 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36711]: saw 50 objects 2024-09-11T02:01:20.880 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36711]: shutting down. 2024-09-11T02:01:21.798 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:21.798 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36710]: starting. 2024-09-11T02:01:21.798 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36710]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36672 2024-09-11T02:01:21.798 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36710]: shutting down. 2024-09-11T02:01:21.799 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:21.799 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:21.799 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:01:21.802 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:01:23.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36780]: starting. 2024-09-11T02:01:23.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36780]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36779 2024-09-11T02:01:23.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36780]: created object 0... 2024-09-11T02:01:23.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36780]: created object 25... 2024-09-11T02:01:23.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36780]: created object 49... 2024-09-11T02:01:23.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36780]: finishing. 2024-09-11T02:01:23.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36780]: shutting down. 2024-09-11T02:01:24.637 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36781]: starting. 2024-09-11T02:01:24.637 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36781]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36779 2024-09-11T02:01:24.637 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36781]: shutting down. 2024-09-11T02:01:26.738 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:26.739 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36816]: starting. 2024-09-11T02:01:26.739 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36816]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36779 2024-09-11T02:01:26.739 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36816]: created object 0... 2024-09-11T02:01:26.739 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36816]: created object 25... 2024-09-11T02:01:26.739 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36816]: created object 49... 2024-09-11T02:01:26.739 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36816]: finishing. 2024-09-11T02:01:26.739 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36816]: shutting down. 2024-09-11T02:01:26.749 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:26.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36818]: starting. 2024-09-11T02:01:26.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36818]: listing objects. 2024-09-11T02:01:26.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36818]: listed object 0... 2024-09-11T02:01:26.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36818]: listed object 25... 2024-09-11T02:01:26.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36818]: saw 50 objects 2024-09-11T02:01:26.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36818]: shutting down. 2024-09-11T02:01:27.682 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:27.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36817]: starting. 2024-09-11T02:01:27.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36817]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36779 2024-09-11T02:01:27.682 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36817]: shutting down. 2024-09-11T02:01:27.683 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:27.683 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:27.683 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:01:27.686 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:01:29.770 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36887]: starting. 2024-09-11T02:01:29.770 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36887]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36886 2024-09-11T02:01:29.770 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36887]: created object 0... 2024-09-11T02:01:29.770 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36887]: created object 25... 2024-09-11T02:01:29.770 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36887]: created object 49... 2024-09-11T02:01:29.770 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36887]: finishing. 2024-09-11T02:01:29.770 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36887]: shutting down. 2024-09-11T02:01:30.707 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36888]: starting. 2024-09-11T02:01:30.707 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36888]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36886 2024-09-11T02:01:30.707 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36888]: shutting down. 2024-09-11T02:01:32.722 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:32.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36923]: starting. 2024-09-11T02:01:32.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36923]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36886 2024-09-11T02:01:32.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36923]: created object 0... 2024-09-11T02:01:32.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36923]: created object 25... 2024-09-11T02:01:32.723 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36923]: created object 49... 2024-09-11T02:01:32.723 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36923]: finishing. 2024-09-11T02:01:32.723 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[36923]: shutting down. 2024-09-11T02:01:32.732 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:32.732 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36925]: starting. 2024-09-11T02:01:32.732 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36925]: listing objects. 2024-09-11T02:01:32.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36925]: listed object 0... 2024-09-11T02:01:32.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36925]: listed object 25... 2024-09-11T02:01:32.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36925]: saw 50 objects 2024-09-11T02:01:32.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[36925]: shutting down. 2024-09-11T02:01:33.629 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:33.629 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36924]: starting. 2024-09-11T02:01:33.630 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36924]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36886 2024-09-11T02:01:33.630 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[36924]: shutting down. 2024-09-11T02:01:33.631 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:33.631 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:33.631 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:01:33.634 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:01:35.728 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36994]: starting. 2024-09-11T02:01:35.728 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36994]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36993 2024-09-11T02:01:35.728 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36994]: created object 0... 2024-09-11T02:01:35.728 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36994]: created object 25... 2024-09-11T02:01:35.728 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36994]: created object 49... 2024-09-11T02:01:35.728 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36994]: finishing. 2024-09-11T02:01:35.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[36994]: shutting down. 2024-09-11T02:01:36.649 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36995]: starting. 2024-09-11T02:01:36.649 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36995]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36993 2024-09-11T02:01:36.649 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[36995]: shutting down. 2024-09-11T02:01:38.755 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:38.755 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37030]: starting. 2024-09-11T02:01:38.755 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37030]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-36993 2024-09-11T02:01:38.755 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37030]: created object 0... 2024-09-11T02:01:38.755 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37030]: created object 25... 2024-09-11T02:01:38.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37030]: created object 49... 2024-09-11T02:01:38.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37030]: finishing. 2024-09-11T02:01:38.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37030]: shutting down. 2024-09-11T02:01:38.765 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:38.765 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37032]: starting. 2024-09-11T02:01:38.765 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37032]: listing objects. 2024-09-11T02:01:38.766 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37032]: listed object 0... 2024-09-11T02:01:38.766 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37032]: listed object 25... 2024-09-11T02:01:38.766 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37032]: saw 50 objects 2024-09-11T02:01:38.766 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37032]: shutting down. 2024-09-11T02:01:39.669 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:39.670 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37031]: starting. 2024-09-11T02:01:39.670 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37031]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-36993 2024-09-11T02:01:39.670 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37031]: shutting down. 2024-09-11T02:01:39.671 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:39.671 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:39.672 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:01:39.675 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:01:41.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37101]: starting. 2024-09-11T02:01:41.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37101]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37100 2024-09-11T02:01:41.795 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37101]: created object 0... 2024-09-11T02:01:41.795 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37101]: created object 25... 2024-09-11T02:01:41.795 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37101]: created object 49... 2024-09-11T02:01:41.795 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37101]: finishing. 2024-09-11T02:01:41.795 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37101]: shutting down. 2024-09-11T02:01:42.638 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37102]: starting. 2024-09-11T02:01:42.639 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37102]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37100 2024-09-11T02:01:42.639 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37102]: shutting down. 2024-09-11T02:01:44.728 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:44.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37137]: starting. 2024-09-11T02:01:44.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37137]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37100 2024-09-11T02:01:44.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37137]: created object 0... 2024-09-11T02:01:44.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37137]: created object 25... 2024-09-11T02:01:44.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37137]: created object 49... 2024-09-11T02:01:44.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37137]: finishing. 2024-09-11T02:01:44.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37137]: shutting down. 2024-09-11T02:01:44.740 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:44.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37139]: starting. 2024-09-11T02:01:44.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37139]: listing objects. 2024-09-11T02:01:44.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37139]: listed object 0... 2024-09-11T02:01:44.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37139]: listed object 25... 2024-09-11T02:01:44.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37139]: saw 50 objects 2024-09-11T02:01:44.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37139]: shutting down. 2024-09-11T02:01:45.660 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:45.660 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37138]: starting. 2024-09-11T02:01:45.660 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37138]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37100 2024-09-11T02:01:45.660 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37138]: shutting down. 2024-09-11T02:01:45.661 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:45.661 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:45.661 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:01:45.663 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:01:47.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37208]: starting. 2024-09-11T02:01:47.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37208]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37207 2024-09-11T02:01:47.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37208]: created object 0... 2024-09-11T02:01:47.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37208]: created object 25... 2024-09-11T02:01:47.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37208]: created object 49... 2024-09-11T02:01:47.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37208]: finishing. 2024-09-11T02:01:47.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37208]: shutting down. 2024-09-11T02:01:48.678 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37209]: starting. 2024-09-11T02:01:48.678 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37209]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37207 2024-09-11T02:01:48.679 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37209]: shutting down. 2024-09-11T02:01:50.784 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:50.785 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37244]: starting. 2024-09-11T02:01:50.785 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37244]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37207 2024-09-11T02:01:50.785 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37244]: created object 0... 2024-09-11T02:01:50.785 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37244]: created object 25... 2024-09-11T02:01:50.785 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37244]: created object 49... 2024-09-11T02:01:50.785 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37244]: finishing. 2024-09-11T02:01:50.785 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37244]: shutting down. 2024-09-11T02:01:50.793 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:50.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37246]: starting. 2024-09-11T02:01:50.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37246]: listing objects. 2024-09-11T02:01:50.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37246]: listed object 0... 2024-09-11T02:01:50.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37246]: listed object 25... 2024-09-11T02:01:50.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37246]: saw 50 objects 2024-09-11T02:01:50.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37246]: shutting down. 2024-09-11T02:01:51.701 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:51.702 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37245]: starting. 2024-09-11T02:01:51.702 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37245]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37207 2024-09-11T02:01:51.702 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37245]: shutting down. 2024-09-11T02:01:51.703 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:51.703 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:51.704 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:01:51.707 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:01:53.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37315]: starting. 2024-09-11T02:01:53.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37315]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37314 2024-09-11T02:01:53.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37315]: created object 0... 2024-09-11T02:01:53.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37315]: created object 25... 2024-09-11T02:01:53.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37315]: created object 49... 2024-09-11T02:01:53.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37315]: finishing. 2024-09-11T02:01:53.709 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37315]: shutting down. 2024-09-11T02:01:54.641 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37316]: starting. 2024-09-11T02:01:54.641 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37316]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37314 2024-09-11T02:01:54.641 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37316]: shutting down. 2024-09-11T02:01:56.739 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:56.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37351]: starting. 2024-09-11T02:01:56.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37351]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37314 2024-09-11T02:01:56.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37351]: created object 0... 2024-09-11T02:01:56.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37351]: created object 25... 2024-09-11T02:01:56.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37351]: created object 49... 2024-09-11T02:01:56.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37351]: finishing. 2024-09-11T02:01:56.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37351]: shutting down. 2024-09-11T02:01:56.749 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:56.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37353]: starting. 2024-09-11T02:01:56.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37353]: listing objects. 2024-09-11T02:01:56.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37353]: listed object 0... 2024-09-11T02:01:56.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37353]: listed object 25... 2024-09-11T02:01:56.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37353]: saw 50 objects 2024-09-11T02:01:56.750 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37353]: shutting down. 2024-09-11T02:01:57.650 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:57.650 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37352]: starting. 2024-09-11T02:01:57.650 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37352]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37314 2024-09-11T02:01:57.651 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37352]: shutting down. 2024-09-11T02:01:57.652 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:57.652 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:01:57.652 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:01:57.655 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:01:59.780 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37422]: starting. 2024-09-11T02:01:59.780 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37422]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37421 2024-09-11T02:01:59.780 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37422]: created object 0... 2024-09-11T02:01:59.780 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37422]: created object 25... 2024-09-11T02:01:59.780 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37422]: created object 49... 2024-09-11T02:01:59.780 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37422]: finishing. 2024-09-11T02:01:59.780 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37422]: shutting down. 2024-09-11T02:02:00.694 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37423]: starting. 2024-09-11T02:02:00.694 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37423]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37421 2024-09-11T02:02:00.694 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37423]: shutting down. 2024-09-11T02:02:02.719 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:02.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37458]: starting. 2024-09-11T02:02:02.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37458]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37421 2024-09-11T02:02:02.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37458]: created object 0... 2024-09-11T02:02:02.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37458]: created object 25... 2024-09-11T02:02:02.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37458]: created object 49... 2024-09-11T02:02:02.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37458]: finishing. 2024-09-11T02:02:02.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37458]: shutting down. 2024-09-11T02:02:02.729 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:02.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37460]: starting. 2024-09-11T02:02:02.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37460]: listing objects. 2024-09-11T02:02:02.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37460]: listed object 0... 2024-09-11T02:02:02.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37460]: listed object 25... 2024-09-11T02:02:02.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37460]: saw 50 objects 2024-09-11T02:02:02.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37460]: shutting down. 2024-09-11T02:02:03.639 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:03.639 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37459]: starting. 2024-09-11T02:02:03.639 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37459]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37421 2024-09-11T02:02:03.639 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37459]: shutting down. 2024-09-11T02:02:03.640 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:03.640 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:03.640 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:02:03.642 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:02:05.730 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37529]: starting. 2024-09-11T02:02:05.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37529]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37528 2024-09-11T02:02:05.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37529]: created object 0... 2024-09-11T02:02:05.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37529]: created object 25... 2024-09-11T02:02:05.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37529]: created object 49... 2024-09-11T02:02:05.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37529]: finishing. 2024-09-11T02:02:05.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37529]: shutting down. 2024-09-11T02:02:06.659 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37530]: starting. 2024-09-11T02:02:06.659 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37530]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37528 2024-09-11T02:02:06.659 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37530]: shutting down. 2024-09-11T02:02:08.763 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:08.763 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37565]: starting. 2024-09-11T02:02:08.763 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37565]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37528 2024-09-11T02:02:08.763 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37565]: created object 0... 2024-09-11T02:02:08.763 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37565]: created object 25... 2024-09-11T02:02:08.763 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37565]: created object 49... 2024-09-11T02:02:08.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37565]: finishing. 2024-09-11T02:02:08.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37565]: shutting down. 2024-09-11T02:02:08.773 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:08.773 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37567]: starting. 2024-09-11T02:02:08.773 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37567]: listing objects. 2024-09-11T02:02:08.773 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37567]: listed object 0... 2024-09-11T02:02:08.774 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37567]: listed object 25... 2024-09-11T02:02:08.774 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37567]: saw 50 objects 2024-09-11T02:02:08.774 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37567]: shutting down. 2024-09-11T02:02:09.696 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:09.696 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37566]: starting. 2024-09-11T02:02:09.696 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37566]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37528 2024-09-11T02:02:09.696 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37566]: shutting down. 2024-09-11T02:02:09.698 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:09.698 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:09.698 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:02:09.702 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:02:11.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37636]: starting. 2024-09-11T02:02:11.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37636]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37635 2024-09-11T02:02:11.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37636]: created object 0... 2024-09-11T02:02:11.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37636]: created object 25... 2024-09-11T02:02:11.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37636]: created object 49... 2024-09-11T02:02:11.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37636]: finishing. 2024-09-11T02:02:11.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37636]: shutting down. 2024-09-11T02:02:12.638 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37637]: starting. 2024-09-11T02:02:12.638 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37637]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37635 2024-09-11T02:02:12.638 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37637]: shutting down. 2024-09-11T02:02:14.748 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:14.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37672]: starting. 2024-09-11T02:02:14.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37672]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37635 2024-09-11T02:02:14.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37672]: created object 0... 2024-09-11T02:02:14.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37672]: created object 25... 2024-09-11T02:02:14.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37672]: created object 49... 2024-09-11T02:02:14.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37672]: finishing. 2024-09-11T02:02:14.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37672]: shutting down. 2024-09-11T02:02:14.759 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:14.760 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37674]: starting. 2024-09-11T02:02:14.760 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37674]: listing objects. 2024-09-11T02:02:14.760 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37674]: listed object 0... 2024-09-11T02:02:14.760 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37674]: listed object 25... 2024-09-11T02:02:14.760 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37674]: saw 50 objects 2024-09-11T02:02:14.760 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37674]: shutting down. 2024-09-11T02:02:15.683 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:15.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37673]: starting. 2024-09-11T02:02:15.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37673]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37635 2024-09-11T02:02:15.683 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37673]: shutting down. 2024-09-11T02:02:15.685 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:15.685 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:15.685 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:02:15.687 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:02:17.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37743]: starting. 2024-09-11T02:02:17.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37743]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37742 2024-09-11T02:02:17.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37743]: created object 0... 2024-09-11T02:02:17.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37743]: created object 25... 2024-09-11T02:02:17.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37743]: created object 49... 2024-09-11T02:02:17.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37743]: finishing. 2024-09-11T02:02:17.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37743]: shutting down. 2024-09-11T02:02:18.704 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37744]: starting. 2024-09-11T02:02:18.705 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37744]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37742 2024-09-11T02:02:18.705 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37744]: shutting down. 2024-09-11T02:02:20.809 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:20.810 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37779]: starting. 2024-09-11T02:02:20.810 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37779]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37742 2024-09-11T02:02:20.810 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37779]: created object 0... 2024-09-11T02:02:20.810 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37779]: created object 25... 2024-09-11T02:02:20.810 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37779]: created object 49... 2024-09-11T02:02:20.810 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37779]: finishing. 2024-09-11T02:02:20.810 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37779]: shutting down. 2024-09-11T02:02:20.820 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:20.820 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37781]: starting. 2024-09-11T02:02:20.820 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37781]: listing objects. 2024-09-11T02:02:20.820 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37781]: listed object 0... 2024-09-11T02:02:20.821 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37781]: listed object 25... 2024-09-11T02:02:20.821 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37781]: saw 50 objects 2024-09-11T02:02:20.821 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37781]: shutting down. 2024-09-11T02:02:21.743 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:21.743 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37780]: starting. 2024-09-11T02:02:21.743 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37780]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37742 2024-09-11T02:02:21.743 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37780]: shutting down. 2024-09-11T02:02:21.744 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:21.744 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:21.744 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:02:21.747 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:02:23.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37850]: starting. 2024-09-11T02:02:23.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37850]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37849 2024-09-11T02:02:23.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37850]: created object 0... 2024-09-11T02:02:23.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37850]: created object 25... 2024-09-11T02:02:23.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37850]: created object 49... 2024-09-11T02:02:23.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37850]: finishing. 2024-09-11T02:02:23.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37850]: shutting down. 2024-09-11T02:02:24.651 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37851]: starting. 2024-09-11T02:02:24.651 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37851]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37849 2024-09-11T02:02:24.652 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37851]: shutting down. 2024-09-11T02:02:26.746 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:26.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37886]: starting. 2024-09-11T02:02:26.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37886]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37849 2024-09-11T02:02:26.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37886]: created object 0... 2024-09-11T02:02:26.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37886]: created object 25... 2024-09-11T02:02:26.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37886]: created object 49... 2024-09-11T02:02:26.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37886]: finishing. 2024-09-11T02:02:26.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37886]: shutting down. 2024-09-11T02:02:26.757 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:26.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37888]: starting. 2024-09-11T02:02:26.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37888]: listing objects. 2024-09-11T02:02:26.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37888]: listed object 0... 2024-09-11T02:02:26.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37888]: listed object 25... 2024-09-11T02:02:26.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37888]: saw 50 objects 2024-09-11T02:02:26.758 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37888]: shutting down. 2024-09-11T02:02:27.679 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:27.679 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37887]: starting. 2024-09-11T02:02:27.679 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37887]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37849 2024-09-11T02:02:27.679 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37887]: shutting down. 2024-09-11T02:02:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:02:27.684 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:02:29.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37957]: starting. 2024-09-11T02:02:29.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37957]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37956 2024-09-11T02:02:29.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37957]: created object 0... 2024-09-11T02:02:29.788 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37957]: created object 25... 2024-09-11T02:02:29.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37957]: created object 49... 2024-09-11T02:02:29.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37957]: finishing. 2024-09-11T02:02:29.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[37957]: shutting down. 2024-09-11T02:02:30.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37958]: starting. 2024-09-11T02:02:30.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37958]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37956 2024-09-11T02:02:30.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[37958]: shutting down. 2024-09-11T02:02:32.733 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:32.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37993]: starting. 2024-09-11T02:02:32.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37993]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-37956 2024-09-11T02:02:32.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37993]: created object 0... 2024-09-11T02:02:32.734 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37993]: created object 25... 2024-09-11T02:02:32.734 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37993]: created object 49... 2024-09-11T02:02:32.734 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37993]: finishing. 2024-09-11T02:02:32.734 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[37993]: shutting down. 2024-09-11T02:02:32.743 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:32.744 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37995]: starting. 2024-09-11T02:02:32.744 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37995]: listing objects. 2024-09-11T02:02:32.744 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37995]: listed object 0... 2024-09-11T02:02:32.744 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37995]: listed object 25... 2024-09-11T02:02:32.744 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37995]: saw 50 objects 2024-09-11T02:02:32.744 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[37995]: shutting down. 2024-09-11T02:02:33.642 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:33.642 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37994]: starting. 2024-09-11T02:02:33.642 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37994]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-37956 2024-09-11T02:02:33.642 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[37994]: shutting down. 2024-09-11T02:02:33.643 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:33.643 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:33.643 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:02:33.645 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:02:35.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38064]: starting. 2024-09-11T02:02:35.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38064]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38063 2024-09-11T02:02:35.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38064]: created object 0... 2024-09-11T02:02:35.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38064]: created object 25... 2024-09-11T02:02:35.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38064]: created object 49... 2024-09-11T02:02:35.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38064]: finishing. 2024-09-11T02:02:35.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38064]: shutting down. 2024-09-11T02:02:36.661 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38065]: starting. 2024-09-11T02:02:36.661 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38065]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38063 2024-09-11T02:02:36.661 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38065]: shutting down. 2024-09-11T02:02:38.768 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:38.769 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38100]: starting. 2024-09-11T02:02:38.769 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38100]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38063 2024-09-11T02:02:38.769 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38100]: created object 0... 2024-09-11T02:02:38.769 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38100]: created object 25... 2024-09-11T02:02:38.769 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38100]: created object 49... 2024-09-11T02:02:38.769 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38100]: finishing. 2024-09-11T02:02:38.769 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38100]: shutting down. 2024-09-11T02:02:38.779 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:38.779 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38102]: starting. 2024-09-11T02:02:38.779 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38102]: listing objects. 2024-09-11T02:02:38.779 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38102]: listed object 0... 2024-09-11T02:02:38.779 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38102]: listed object 25... 2024-09-11T02:02:38.779 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38102]: saw 50 objects 2024-09-11T02:02:38.780 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38102]: shutting down. 2024-09-11T02:02:39.691 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:39.691 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38101]: starting. 2024-09-11T02:02:39.691 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38101]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38063 2024-09-11T02:02:39.692 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38101]: shutting down. 2024-09-11T02:02:39.693 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:39.693 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:39.693 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:02:39.695 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:02:41.800 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38171]: starting. 2024-09-11T02:02:41.801 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38171]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38170 2024-09-11T02:02:41.801 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38171]: created object 0... 2024-09-11T02:02:41.801 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38171]: created object 25... 2024-09-11T02:02:41.801 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38171]: created object 49... 2024-09-11T02:02:41.801 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38171]: finishing. 2024-09-11T02:02:41.801 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38171]: shutting down. 2024-09-11T02:02:42.654 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38172]: starting. 2024-09-11T02:02:42.654 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38172]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38170 2024-09-11T02:02:42.654 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38172]: shutting down. 2024-09-11T02:02:44.205 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-11T02:02:44.205 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T02:02:44.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T02:02:44.209 INFO:tasks.ceph.mon.b:Started 2024-09-11T02:02:44.209 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-11T02:02:44.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:02:44.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.318+0000 7f4a22794640 10 monclient: get_monmap_and_config 2024-09-11T02:02:44.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.318+0000 7f4a22794640 10 monclient: build_initial_monmap 2024-09-11T02:02:44.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.318+0000 7f4a22794640 10 monclient: monmap: 2024-09-11T02:02:44.320 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:44.320 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:44.319582+0000 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:44.319582+0000 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:44.321 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:44.322 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.319+0000 7f4a22794640 1 Processor -- start 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.319+0000 7f4a22794640 1 -- start start 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.319+0000 7f4a22794640 10 monclient: init 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 10 monclient: _add_conns ranks=[4,7,1,3,0,2,8,6,5] 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 10 monclient(hunting): picked mon.noname-c con 0x7f4a1c138960 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 10 monclient(hunting): picked mon.noname-i con 0x7f4a1c139450 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 10 monclient(hunting): picked mon.noname-f con 0x7f4a1c13f620 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c09d030 con 0x7f4a1c13f620 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c09d310 con 0x7f4a1c138960 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c06f770 con 0x7f4a1c139450 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:44.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1bfff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f4a1c138960 0x7f4a1c138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50628/0 (socket says 172.21.15.73:50628) 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1bfff640 1 -- 172.21.15.73:0/1385662502 learned_addr learned my addr 172.21.15.73:0/1385662502 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 10 monclient(hunting): authenticate will time out at 1005.924296s 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892818941 0 0) 0x7f4a1c09d310 con 0x7f4a1c138960 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient(hunting): my global_id is 5701 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a04003520 con 0x7f4a1c138960 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140948137 0 0) 0x7f4a1c06f770 con 0x7f4a1c139450 2024-09-11T02:02:44.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient(hunting): my global_id is 5686 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a1c09d310 con 0x7f4a1c139450 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3351887770 0 0) 0x7f4a04003520 con 0x7f4a1c138960 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 >> v1:172.21.15.203:6792/0 conn(0x7f4a1c139450 legacy=0x7f4a1c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 >> v1:172.21.15.203:6789/0 conn(0x7f4a1c13f620 legacy=0x7f4a1c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: _finish_hunting 0 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 monclient: found mon.noname-c 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c0a7360 con 0x7f4a1c138960 2024-09-11T02:02:44.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: _finish_auth 0 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: _check_auth_tickets 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 5 monclient: authenticate success, global_id 5701 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4a0c001830 con 0x7f4a1c138960 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: dump: 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a0c001a50 con 0x7f4a1c138960 2024-09-11T02:02:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 1 -- 172.21.15.73:0/1385662502 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4a0c001d40 con 0x7f4a1c138960 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a1affd640 10 monclient: dump: 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.320+0000 7f4a22794640 4 set_mon_vals no callback set 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.321+0000 7f4a22794640 10 monclient: shutdown 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.321+0000 7f4a22794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.321+0000 7f4a22794640 1 -- 172.21.15.73:0/1385662502 >> v1:172.21.15.73:6791/0 conn(0x7f4a1c138960 legacy=0x7f4a1c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.321+0000 7f4a22794640 1 -- 172.21.15.73:0/1385662502 shutdown_connections 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.321+0000 7f4a22794640 1 -- 172.21.15.73:0/1385662502 >> 172.21.15.73:0/1385662502 conn(0x7f4a1c0a8050 msgr2=0x7f4a1c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.321+0000 7f4a22794640 1 -- 172.21.15.73:0/1385662502 shutdown_connections 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.321+0000 7f4a22794640 1 -- 172.21.15.73:0/1385662502 wait complete. 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.322+0000 7f4a22794640 10 monclient: build_initial_monmap 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.322+0000 7f4a22794640 10 monclient: monmap: 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.322+0000 7f4a22794640 1 Processor -- start 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.322+0000 7f4a22794640 1 -- start start 2024-09-11T02:02:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.322+0000 7f4a22794640 10 monclient: init 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 10 monclient: _add_conns ranks=[7,6,8,0,5,4,2,1,3] 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 10 monclient(hunting): picked mon.noname-i con 0x7f4a1c138960 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 10 monclient(hunting): picked mon.noname-d con 0x7f4a1c139450 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 10 monclient(hunting): picked mon.noname-e con 0x7f4a1c13f620 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c13c5a0 con 0x7f4a1c139450 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c13ef30 con 0x7f4a1c138960 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c142940 con 0x7f4a1c13f620 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a22794640 10 monclient(hunting): authenticate will time out at 1005.927344s 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a20d31640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f4a1c13f620 0x7f4a1c1d5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35272/0 (socket says 172.21.15.73:35272) 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a1b7fe640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f4a1c139450 0x7f4a1c1d2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39856/0 (socket says 172.21.15.73:39856) 2024-09-11T02:02:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a20d31640 1 -- 172.21.15.73:0/2544050543 learned_addr learned my addr 172.21.15.73:0/2544050543 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868813713 0 0) 0x7f4a1c142940 con 0x7f4a1c13f620 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): my global_id is 114848 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a08003550 con 0x7f4a1c13f620 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578562891 0 0) 0x7f4a1c13c5a0 con 0x7f4a1c139450 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): my global_id is 114855 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a1c142940 con 0x7f4a1c139450 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537224573 0 0) 0x7f4a1c0a7360 con 0x7f4a1c138960 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 10 monclient(hunting): my global_id is 5695 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a1c13c5a0 con 0x7f4a1c138960 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 64250210 0 0) 0x7f4a08003550 con 0x7f4a1c13f620 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a1c0a7360 con 0x7f4a1c13f620 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.323+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2588970273 0 0) 0x7f4a1c142940 con 0x7f4a1c139450 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a08003550 con 0x7f4a1c139450 2024-09-11T02:02:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4a10001a90 con 0x7f4a1c139450 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): dump: 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.346 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:44.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4a14001d30 con 0x7f4a1c13f620 2024-09-11T02:02:44.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:44.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): dump: 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2642486073 0 0) 0x7f4a1c13c5a0 con 0x7f4a1c138960 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a1c142940 con 0x7f4a1c138960 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4a0c0017f0 con 0x7f4a1c138960 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient(hunting): dump: 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.349 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 985259934 0 0) 0x7f4a1c0a7360 con 0x7f4a1c13f620 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 >> v1:172.21.15.203:6792/0 conn(0x7f4a1c138960 legacy=0x7f4a1c13e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 >> v1:172.21.15.73:6792/0 conn(0x7f4a1c139450 legacy=0x7f4a1c1d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 monclient: found mon.e 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c13c2c0 con 0x7f4a1c13f620 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient: _finish_auth 0 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a22794640 5 monclient: authenticate success, global_id 114848 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a22794640 10 monclient: _renew_subs 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a22794640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:44.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c13cb60 con 0x7f4a1c13f620 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a22794640 10 monclient: _renew_subs 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a22794640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1421d0 con 0x7f4a1c13f620 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a14002070 con 0x7f4a1c13f620 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4a14003f80 con 0x7f4a1c13f620 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a18ff9640 10 monclient: dump: 2024-09-11T02:02:44.352 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.353 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.354 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.324+0000 7f4a1a7fc640 4 set_mon_vals no callback set 2024-09-11T02:02:44.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.325+0000 7f4a22794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:44.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.325+0000 7f4a22794640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:44.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.325+0000 7f4a22794640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:44.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.325+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49fc005080 con 0x7f4a1c13f620 2024-09-11T02:02:44.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.325+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f4a14004120 con 0x7f4a1c13f620 2024-09-11T02:02:44.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.326+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(212..212 src has 1..212) ==== 3898+0+0 (unknown 3207809470 0 0) 0x7f4a1404e5c0 con 0x7f4a1c13f620 2024-09-11T02:02:44.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.326+0000 7f4a1bfff640 10 monclient: get_auth_request con 0x7f4a080406d0 auth_method 0 2024-09-11T02:02:44.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.331+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f4a14017700 con 0x7f4a1c13f620 2024-09-11T02:02:44.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.331+0000 7f4a18ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:44.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.331+0000 7f4a18ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.578+0000 7f4a22794640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:02:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.578+0000 7f4a22794640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:02:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.578+0000 7f4a22794640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.578+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f49fc005370 con 0x7f4a1c13f620 2024-09-11T02:02:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.578+0000 7f4a18ff9640 1 -- 172.21.15.73:0/2544050543 <== mon.8 v1:172.21.15.73:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 2607591660) 0x7f4a14017000 con 0x7f4a1c13f620 2024-09-11T02:02:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.578+0000 7f4a18ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:02:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.578+0000 7f4a18ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:44.581 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":40,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:02:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.581+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 >> v1:172.21.15.203:6812/2311533528 conn(0x7f4a080406d0 legacy=0x7f4a08042b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.581+0000 7f4a22794640 10 monclient: shutdown 2024-09-11T02:02:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.581+0000 7f4a22794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.581+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 >> v1:172.21.15.73:6793/0 conn(0x7f4a1c13f620 legacy=0x7f4a1c1d5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.581+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 shutdown_connections 2024-09-11T02:02:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.581+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 >> 172.21.15.73:0/2544050543 conn(0x7f4a1c0a8050 msgr2=0x7f4a1c0a8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.581+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 shutdown_connections 2024-09-11T02:02:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.581+0000 7f4a22794640 1 -- 172.21.15.73:0/2544050543 wait complete. 2024-09-11T02:02:44.592 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-11T02:02:44.592 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-11T02:02:44.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T02:02:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.689+0000 7f9d15a5a640 10 monclient: get_monmap_and_config 2024-09-11T02:02:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.689+0000 7f9d15a5a640 10 monclient: build_initial_monmap 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.689+0000 7f9d15a5a640 10 monclient: monmap: 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:44.690129+0000 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:44.690129+0000 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:44.701 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.689+0000 7f9d15a5a640 1 Processor -- start 2024-09-11T02:02:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.689+0000 7f9d15a5a640 1 -- start start 2024-09-11T02:02:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.689+0000 7f9d15a5a640 10 monclient: init 2024-09-11T02:02:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 10 monclient: _add_conns ranks=[0,8,3,2,4,5,6,7,1] 2024-09-11T02:02:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 10 monclient(hunting): picked mon.noname-a con 0x7f9d10138960 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 10 monclient(hunting): picked mon.noname-e con 0x7f9d10139450 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 10 monclient(hunting): picked mon.noname-g con 0x7f9d1013f620 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1009d030 con 0x7f9d10138960 2024-09-11T02:02:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1009d310 con 0x7f9d1013f620 2024-09-11T02:02:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1006f770 con 0x7f9d10139450 2024-09-11T02:02:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 10 monclient(hunting): authenticate will time out at 1006.294425s 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0effd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9d10138960 0x7f9d10138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47086/0 (socket says 172.21.15.73:47086) 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0e7fc640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f9d10139450 0x7f9d1013df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35282/0 (socket says 172.21.15.73:35282) 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0effd640 1 -- 172.21.15.73:0/2929111835 learned_addr learned my addr 172.21.15.73:0/2929111835 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744651102 0 0) 0x7f9d1006f770 con 0x7f9d10139450 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient(hunting): my global_id is 114857 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cfc003520 con 0x7f9d10139450 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772008671 0 0) 0x7f9d1009d030 con 0x7f9d10138960 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient(hunting): my global_id is 5895 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d1006f770 con 0x7f9d10138960 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2575745766 0 0) 0x7f9cfc003520 con 0x7f9d10139450 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 >> v1:172.21.15.203:6790/0 conn(0x7f9d1013f620 legacy=0x7f9d10141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 >> v1:172.21.15.73:6789/0 conn(0x7f9d10138960 legacy=0x7f9d10138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient: _finish_hunting 0 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 monclient: found mon.noname-e 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d100a7360 con 0x7f9d10139450 2024-09-11T02:02:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient: _finish_auth 0 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 10 monclient: _check_auth_tickets 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9cf8001830 con 0x7f9d10139450 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 5 monclient: authenticate success, global_id 114857 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.690+0000 7f9d15a5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d0dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d0dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d0dffb640 10 monclient: dump: 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9cf8001a50 con 0x7f9d10139450 2024-09-11T02:02:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d0dffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 4 set_mon_vals no callback set 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d0dffb640 1 -- 172.21.15.73:0/2929111835 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9cf8001d40 con 0x7f9d10139450 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d0dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d0dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d0dffb640 10 monclient: dump: 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 10 monclient: shutdown 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:44.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 1 -- 172.21.15.73:0/2929111835 >> v1:172.21.15.73:6793/0 conn(0x7f9d10139450 legacy=0x7f9d1013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 1 -- 172.21.15.73:0/2929111835 shutdown_connections 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 1 -- 172.21.15.73:0/2929111835 >> 172.21.15.73:0/2929111835 conn(0x7f9d100a8050 msgr2=0x7f9d100a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 1 -- 172.21.15.73:0/2929111835 shutdown_connections 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.691+0000 7f9d15a5a640 1 -- 172.21.15.73:0/2929111835 wait complete. 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.692+0000 7f9d15a5a640 10 monclient: build_initial_monmap 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.692+0000 7f9d15a5a640 10 monclient: monmap: 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.692+0000 7f9d15a5a640 1 Processor -- start 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.692+0000 7f9d15a5a640 1 -- start start 2024-09-11T02:02:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.692+0000 7f9d15a5a640 10 monclient: init 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 10 monclient: _add_conns ranks=[4,6,8,5,1,2,0,3,7] 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 10 monclient(hunting): picked mon.noname-c con 0x7f9d10138960 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 10 monclient(hunting): picked mon.noname-d con 0x7f9d10139450 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 10 monclient(hunting): picked mon.noname-e con 0x7f9d1013f620 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d10142550 con 0x7f9d10138960 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1006e730 con 0x7f9d10139450 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1013f1e0 con 0x7f9d1013f620 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d15a5a640 10 monclient(hunting): authenticate will time out at 1006.297196s 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d0effd640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f9d10138960 0x7f9d1013e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50638/0 (socket says 172.21.15.73:50638) 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d0e7fc640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f9d10139450 0x7f9d101d26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39868/0 (socket says 172.21.15.73:39868) 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d0effd640 1 -- 172.21.15.73:0/1114117653 learned_addr learned my addr 172.21.15.73:0/1114117653 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716085115 0 0) 0x7f9d1013f1e0 con 0x7f9d1013f620 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): my global_id is 114866 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf0003520 con 0x7f9d1013f620 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3420672866 0 0) 0x7f9d1006e730 con 0x7f9d10139450 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): my global_id is 114864 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d1013f1e0 con 0x7f9d10139450 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372070229 0 0) 0x7f9d10142550 con 0x7f9d10138960 2024-09-11T02:02:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): my global_id is 5710 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d1006e730 con 0x7f9d10138960 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4086925080 0 0) 0x7f9d1013f1e0 con 0x7f9d10139450 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d10142550 con 0x7f9d10139450 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9cf80017f0 con 0x7f9d10139450 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): dump: 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.714 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1773169870 0 0) 0x7f9cf0003520 con 0x7f9d1013f620 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d1013f1e0 con 0x7f9d1013f620 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 833452112 0 0) 0x7f9d1006e730 con 0x7f9d10138960 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cf0003520 con 0x7f9d10138960 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d00001930 con 0x7f9d1013f620 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): dump: 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.715 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.716 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d08001760 con 0x7f9d10138960 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient(hunting): dump: 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.717 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 236349481 0 0) 0x7f9d10142550 con 0x7f9d10139450 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 >> v1:172.21.15.73:6793/0 conn(0x7f9d1013f620 legacy=0x7f9d101d5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 >> v1:172.21.15.73:6791/0 conn(0x7f9d10138960 legacy=0x7f9d1013e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient: _finish_hunting 0 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 monclient: found mon.d 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1013cad0 con 0x7f9d10139450 2024-09-11T02:02:44.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient: _finish_auth 0 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 10 monclient: _check_auth_tickets 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.693+0000 7f9d07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d15a5a640 5 monclient: authenticate success, global_id 114864 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d15a5a640 10 monclient: _renew_subs 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d15a5a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1013c230 con 0x7f9d10139450 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d15a5a640 10 monclient: _renew_subs 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d15a5a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d10141da0 con 0x7f9d10139450 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9cf80011f0 con 0x7f9d10139450 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d07fff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9cf8001a50 con 0x7f9d10139450 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d07fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d0d7fa640 4 set_mon_vals no callback set 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d07fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d07fff640 10 monclient: dump: 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.720 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d15a5a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9cf40065c0 con 0x7f9cf4002860 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.694+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9cf80117d0 con 0x7f9d10139450 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(212..212 src has 1..212) ==== 3898+0+0 (unknown 3207809470 0 0) 0x7f9cf804e400 con 0x7f9d10139450 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390643019 0 0) 0x7f9cf40065c0 con 0x7f9cf4002860 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 10 monclient(hunting): my global_id is 5904 2024-09-11T02:02:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d10142550 con 0x7f9cf4002860 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d0f7fe640 10 monclient: get_auth_request con 0x7f9cf0040760 auth_method 0 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4133213077 0 0) 0x7f9d10142550 con 0x7f9cf4002860 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cf40065c0 con 0x7f9cf4002860 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d08004ea0 con 0x7f9cf4002860 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 10 monclient: dump: 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1425522648 0 0) 0x7f9cf40065c0 con 0x7f9cf4002860 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cf400a160 con 0x7f9cf4002860 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9d08007080 con 0x7f9cf4002860 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:44.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.695+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 >> v1:172.21.15.73:6789/0 conn(0x7f9cf4002860 legacy=0x7f9cf4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.696+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 >> v1:172.21.15.73:6789/0 conn(0x7f9cf4002860 legacy=0x7f9cf4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:44.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d15a5a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:44.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9cf4009e20 con 0x7f9cf40090e0 2024-09-11T02:02:44.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2594751388 0 0) 0x7f9cf4009e20 con 0x7f9cf40090e0 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 10 monclient(hunting): my global_id is 5913 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf40065c0 con 0x7f9cf40090e0 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3616634315 0 0) 0x7f9cf40065c0 con 0x7f9cf40090e0 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cf4009e20 con 0x7f9cf40090e0 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d08005770 con 0x7f9cf40090e0 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 10 monclient: dump: 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.727 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 616285812 0 0) 0x7f9cf4009e20 con 0x7f9cf40090e0 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 --> v1:172.21.15.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9cf400c3f0 con 0x7f9cf40090e0 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 337431816) 0x7f9d08006cc0 con 0x7f9cf40090e0 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.702+0000 7f9d07fff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 >> v1:172.21.15.73:6789/0 conn(0x7f9cf40090e0 legacy=0x7f9cf4009570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d07fff640 1 -- 172.21.15.73:0/1114117653 >> v1:172.21.15.73:6789/0 conn(0x7f9cf40090e0 legacy=0x7f9cf4009570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:44.729 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 287142, 2024-09-11T02:02:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:44.729 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:44.730 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:44.731 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:44.732 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:44.733 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:44.734 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:44.735 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:44.736 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:44.739 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:44.740 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:44.741 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.742 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.743 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.744 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:44.746 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.747 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:44.749 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:44.750 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:44.751 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.752 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:44.752 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:44.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9cf0040760 legacy=0x7f9cf0042c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d15a5a640 10 monclient: shutdown 2024-09-11T02:02:44.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d15a5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:44.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 >> v1:172.21.15.73:6792/0 conn(0x7f9d10139450 legacy=0x7f9d101d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d0f7fe640 1 -- 172.21.15.73:0/1114117653 reap_dead start 2024-09-11T02:02:44.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d0f7fe640 1 -- 172.21.15.73:0/1114117653 reap_dead start 2024-09-11T02:02:44.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 shutdown_connections 2024-09-11T02:02:44.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 >> 172.21.15.73:0/1114117653 conn(0x7f9d100a8050 msgr2=0x7f9d100a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:44.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 shutdown_connections 2024-09-11T02:02:44.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.703+0000 7f9d15a5a640 1 -- 172.21.15.73:0/1114117653 wait complete. 2024-09-11T02:02:44.754 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:44.756 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-11T02:02:44.756 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T02:02:44.794 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:44.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38207]: starting. 2024-09-11T02:02:44.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38207]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38170 2024-09-11T02:02:44.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38207]: created object 0... 2024-09-11T02:02:44.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38207]: created object 25... 2024-09-11T02:02:44.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38207]: created object 49... 2024-09-11T02:02:44.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38207]: finishing. 2024-09-11T02:02:44.794 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38207]: shutting down. 2024-09-11T02:02:44.805 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:44.805 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38209]: starting. 2024-09-11T02:02:44.805 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38209]: listing objects. 2024-09-11T02:02:44.805 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38209]: listed object 0... 2024-09-11T02:02:44.805 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38209]: listed object 25... 2024-09-11T02:02:44.805 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38209]: saw 50 objects 2024-09-11T02:02:44.806 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38209]: shutting down. 2024-09-11T02:02:44.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.855+0000 7f5c9755d640 10 monclient: get_monmap_and_config 2024-09-11T02:02:44.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.855+0000 7f5c9755d640 10 monclient: build_initial_monmap 2024-09-11T02:02:44.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.855+0000 7f5c9755d640 10 monclient: monmap: 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:44.856007+0000 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:44.856007+0000 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:44.857 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:44.858 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:44.858 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.855+0000 7f5c9755d640 1 Processor -- start 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.855+0000 7f5c9755d640 1 -- start start 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.855+0000 7f5c9755d640 10 monclient: init 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 10 monclient: _add_conns ranks=[2,1,8,5,6,7,0,3,4] 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 10 monclient(hunting): picked mon.noname-b con 0x7f5c90138960 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 10 monclient(hunting): picked mon.noname-f con 0x7f5c90139450 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 10 monclient(hunting): picked mon.noname-e con 0x7f5c9013f620 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9009d030 con 0x7f5c90139450 2024-09-11T02:02:44.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9009d310 con 0x7f5c90138960 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9006f770 con 0x7f5c9013f620 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c9755d640 10 monclient(hunting): authenticate will time out at 1006.460460s 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c95afa640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f5c9013f620 0x7f5c90141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35292/0 (socket says 172.21.15.73:35292) 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c95afa640 1 -- 172.21.15.73:0/3250204857 learned_addr learned my addr 172.21.15.73:0/3250204857 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c87fff640 1 -- 172.21.15.73:0/3250204857 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007156098 0 0) 0x7f5c9006f770 con 0x7f5c9013f620 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c87fff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c87fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c87fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c87fff640 10 monclient(hunting): my global_id is 114875 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.856+0000 7f5c87fff640 1 -- 172.21.15.73:0/3250204857 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c7c003520 con 0x7f5c9013f620 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 1 -- 172.21.15.73:0/3250204857 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1740635826 0 0) 0x7f5c7c003520 con 0x7f5c9013f620 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 1 -- 172.21.15.73:0/3250204857 >> v1:172.21.15.73:6790/0 conn(0x7f5c90138960 legacy=0x7f5c90138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 1 -- 172.21.15.73:0/3250204857 >> v1:172.21.15.203:6789/0 conn(0x7f5c90139450 legacy=0x7f5c9013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: _finish_hunting 0 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 1 monclient: found mon.noname-e 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 1 -- 172.21.15.73:0/3250204857 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c900a7360 con 0x7f5c9013f620 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: _finish_auth 0 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: _check_auth_tickets 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 5 monclient: authenticate success, global_id 114875 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 1 -- 172.21.15.73:0/3250204857 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5c8c001bb0 con 0x7f5c9013f620 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:02:44.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: dump: 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.868 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 1 -- 172.21.15.73:0/3250204857 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c8c001dd0 con 0x7f5c9013f620 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 4 set_mon_vals no callback set 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 1 -- 172.21.15.73:0/3250204857 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5c8c004f60 con 0x7f5c9013f620 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c87fff640 10 monclient: dump: 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.869 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 10 monclient: shutdown 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 1 -- 172.21.15.73:0/3250204857 >> v1:172.21.15.73:6793/0 conn(0x7f5c9013f620 legacy=0x7f5c90141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 1 -- 172.21.15.73:0/3250204857 shutdown_connections 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 1 -- 172.21.15.73:0/3250204857 >> 172.21.15.73:0/3250204857 conn(0x7f5c900a8050 msgr2=0x7f5c900a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 1 -- 172.21.15.73:0/3250204857 shutdown_connections 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.857+0000 7f5c9755d640 1 -- 172.21.15.73:0/3250204857 wait complete. 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.858+0000 7f5c9755d640 10 monclient: build_initial_monmap 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.858+0000 7f5c9755d640 10 monclient: monmap: 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:44.871 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:44.872 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.859+0000 7f5c9755d640 1 Processor -- start 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.859+0000 7f5c9755d640 1 -- start start 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.859+0000 7f5c9755d640 10 monclient: init 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.859+0000 7f5c9755d640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.859+0000 7f5c9755d640 10 monclient: _add_conns ranks=[6,7,0,1,5,3,2,4,8] 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.859+0000 7f5c9755d640 10 monclient(hunting): picked mon.noname-d con 0x7f5c90138960 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.859+0000 7f5c9755d640 10 monclient(hunting): picked mon.noname-i con 0x7f5c90139450 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.859+0000 7f5c9755d640 10 monclient(hunting): picked mon.noname-a con 0x7f5c9013f620 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c9755d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9013c7a0 con 0x7f5c9013f620 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c9755d640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9013b280 con 0x7f5c90138960 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c9755d640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c90138760 con 0x7f5c90139450 2024-09-11T02:02:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c9755d640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c9755d640 10 monclient(hunting): authenticate will time out at 1006.464177s 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c952f9640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f5c90138960 0x7f5c90138050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39882/0 (socket says 172.21.15.73:39882) 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c952f9640 1 -- 172.21.15.73:0/3997945306 learned_addr learned my addr 172.21.15.73:0/3997945306 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307071616 0 0) 0x7f5c9013b280 con 0x7f5c90138960 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 10 monclient(hunting): my global_id is 114873 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c74003520 con 0x7f5c90138960 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1843410775 0 0) 0x7f5c9013c7a0 con 0x7f5c9013f620 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 10 monclient(hunting): my global_id is 5922 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.860+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c9013b280 con 0x7f5c9013f620 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1836886094 0 0) 0x7f5c74003520 con 0x7f5c90138960 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c9013c7a0 con 0x7f5c90138960 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5c88001b00 con 0x7f5c90138960 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): dump: 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.875 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 785340609 0 0) 0x7f5c90138760 con 0x7f5c90139450 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): my global_id is 5704 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c74003520 con 0x7f5c90139450 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 630063629 0 0) 0x7f5c9013b280 con 0x7f5c9013f620 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c90138760 con 0x7f5c9013f620 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5c8c001420 con 0x7f5c9013f620 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient(hunting): dump: 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.877 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3832193664 0 0) 0x7f5c9013c7a0 con 0x7f5c90138960 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 >> v1:172.21.15.203:6792/0 conn(0x7f5c90139450 legacy=0x7f5c901d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 >> v1:172.21.15.73:6789/0 conn(0x7f5c9013f620 legacy=0x7f5c901d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:02:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 monclient: found mon.d 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9013f250 con 0x7f5c90138960 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient: _finish_auth 0 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c9755d640 5 monclient: authenticate success, global_id 114873 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c9755d640 10 monclient: _renew_subs 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c9755d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5c900a88d0 con 0x7f5c90138960 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c880038c0 con 0x7f5c90138960 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5c88003df0 con 0x7f5c90138960 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c85ffb640 10 monclient: dump: 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c877fe640 4 set_mon_vals no callback set 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c9755d640 10 monclient: _renew_subs 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c9755d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.861+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5c9013c4c0 con 0x7f5c90138960 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c9755d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f5c88003f90 con 0x7f5c90138960 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5c900008d0 con 0x7f5c90143130 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(213..213 src has 1..213) ==== 3898+0+0 (unknown 1446247296 0 0) 0x7f5c8804e3e0 con 0x7f5c90138960 2024-09-11T02:02:44.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656355941 0 0) 0x7f5c900008d0 con 0x7f5c90143130 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 10 monclient(hunting): my global_id is 134102 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c9013c7a0 con 0x7f5c90143130 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c95afa640 10 monclient: get_auth_request con 0x7f5c74040540 auth_method 0 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3583891328 0 0) 0x7f5c9013c7a0 con 0x7f5c90143130 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c900008d0 con 0x7f5c90143130 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5c800019b0 con 0x7f5c90143130 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.862+0000 7f5c85ffb640 10 monclient: dump: 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.883 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.863+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3836690295 0 0) 0x7f5c900008d0 con 0x7f5c90143130 2024-09-11T02:02:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.863+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c900a5140 con 0x7f5c90143130 2024-09-11T02:02:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.863+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5c80001cd0 con 0x7f5c90143130 2024-09-11T02:02:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.863+0000 7f5c85ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.863+0000 7f5c85ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.863+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 >> v1:172.21.15.73:6790/0 conn(0x7f5c90143130 legacy=0x7f5c90063d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.863+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 >> v1:172.21.15.73:6790/0 conn(0x7f5c90143130 legacy=0x7f5c90063d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c9755d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5c90141120 con 0x7f5c9002e5c0 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 714963226 0 0) 0x7f5c90141120 con 0x7f5c9002e5c0 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 10 monclient(hunting): my global_id is 134111 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c900008d0 con 0x7f5c9002e5c0 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3893572115 0 0) 0x7f5c900008d0 con 0x7f5c9002e5c0 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c90141120 con 0x7f5c9002e5c0 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5c80003be0 con 0x7f5c9002e5c0 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.869+0000 7f5c85ffb640 10 monclient: dump: 2024-09-11T02:02:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3771940555 0 0) 0x7f5c90141120 con 0x7f5c9002e5c0 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 --> v1:172.21.15.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5c9002e9a0 con 0x7f5c9002e5c0 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7541 (unknown 0 0 1354776000) 0x7f5c80005050 con 0x7f5c9002e5c0 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c85ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c85ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 >> v1:172.21.15.73:6790/0 conn(0x7f5c9002e5c0 legacy=0x7f5c90140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c85ffb640 1 -- 172.21.15.73:0/3997945306 >> v1:172.21.15.73:6790/0 conn(0x7f5c9002e5c0 legacy=0x7f5c90140a10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:44.888 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 572, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:44.889 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:44.890 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:44.891 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:44.892 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:44.893 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:44.894 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.896 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:44.897 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:44.898 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.900 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:44.901 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.902 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.904 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:44.905 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:44.906 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:44.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:44.908 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:44.908 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 >> v1:172.21.15.203:6812/2311533528 conn(0x7f5c74040540 legacy=0x7f5c74042a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c9755d640 10 monclient: shutdown 2024-09-11T02:02:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c9755d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 >> v1:172.21.15.73:6792/0 conn(0x7f5c90138960 legacy=0x7f5c90138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c95afa640 1 -- 172.21.15.73:0/3997945306 reap_dead start 2024-09-11T02:02:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c95afa640 1 -- 172.21.15.73:0/3997945306 reap_dead start 2024-09-11T02:02:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 shutdown_connections 2024-09-11T02:02:44.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 >> 172.21.15.73:0/3997945306 conn(0x7f5c900a8050 msgr2=0x7f5c900a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:44.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 shutdown_connections 2024-09-11T02:02:44.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:44.870+0000 7f5c9755d640 1 -- 172.21.15.73:0/3997945306 wait complete. 2024-09-11T02:02:44.910 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:44.910 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-11T02:02:44.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T02:02:45.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.006+0000 7fe34f9b4640 10 monclient: get_monmap_and_config 2024-09-11T02:02:45.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.006+0000 7fe34f9b4640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.006+0000 7fe34f9b4640 10 monclient: monmap: 2024-09-11T02:02:45.008 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.008 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.008 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:45.007568+0000 2024-09-11T02:02:45.008 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:45.007568+0000 2024-09-11T02:02:45.008 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.009 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.007+0000 7fe34f9b4640 1 Processor -- start 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.007+0000 7fe34f9b4640 1 -- start start 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.007+0000 7fe34f9b4640 10 monclient: init 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.007+0000 7fe34f9b4640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.007+0000 7fe34f9b4640 10 monclient: _add_conns ranks=[7,0,8,2,3,1,4,6,5] 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.007+0000 7fe34f9b4640 10 monclient(hunting): picked mon.noname-i con 0x7fe348138d40 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.007+0000 7fe34f9b4640 10 monclient(hunting): picked mon.noname-a con 0x7fe3480a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.007+0000 7fe34f9b4640 10 monclient(hunting): picked mon.noname-e con 0x7fe34813f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.007+0000 7fe34f9b4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34809ca00 con 0x7fe3480a72f0 2024-09-11T02:02:45.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34f9b4640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3480a7070 con 0x7fe348138d40 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34f9b4640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34809cee0 con 0x7fe34813f350 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34f9b4640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34f9b4640 10 monclient(hunting): authenticate will time out at 1006.612026s 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34df51640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fe34813f350 0x7fe348141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35306/0 (socket says 172.21.15.73:35306) 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34cf4f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe3480a72f0 0x7fe34813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47134/0 (socket says 172.21.15.73:47134) 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34df51640 1 -- 172.21.15.73:0/4014693072 learned_addr learned my addr 172.21.15.73:0/4014693072 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206065782 0 0) 0x7fe34809ca00 con 0x7fe3480a72f0 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): my global_id is 5931 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe334003520 con 0x7fe3480a72f0 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168916559 0 0) 0x7fe34809cee0 con 0x7fe34813f350 2024-09-11T02:02:45.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): my global_id is 114884 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe34809ca00 con 0x7fe34813f350 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206873539 0 0) 0x7fe3480a7070 con 0x7fe348138d40 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): my global_id is 5713 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe34809cee0 con 0x7fe348138d40 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 833115730 0 0) 0x7fe334003520 con 0x7fe3480a72f0 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 >> v1:172.21.15.73:6793/0 conn(0x7fe34813f350 legacy=0x7fe348141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 >> v1:172.21.15.203:6792/0 conn(0x7fe348138d40 legacy=0x7fe348139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 monclient: found mon.noname-a 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34809d1c0 con 0x7fe3480a72f0 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe338001850 con 0x7fe3480a72f0 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34f9b4640 5 monclient: authenticate success, global_id 5931 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34f9b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: dump: 2024-09-11T02:02:45.022 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.023 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34f9b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34cf4f640 1 -- 172.21.15.73:0/4014693072 >> v1:172.21.15.73:6789/0 conn(0x7fe3480a72f0 legacy=0x7fe34813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34cf4f640 1 -- 172.21.15.73:0/4014693072 >> v1:172.21.15.73:6789/0 conn(0x7fe3480a72f0 legacy=0x7fe34813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34cf4f640 1 --1- 172.21.15.73:0/4014693072 >> v1:172.21.15.73:6789/0 conn(0x7fe3480a72f0 0x7fe34813dc30 :-1 s=OPENED pgs=309 cs=1 l=1).handle_message read tag failed 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe34cf4f640 1 --1- 172.21.15.73:0/4014693072 >> v1:172.21.15.73:6789/0 conn(0x7fe3480a72f0 0x7fe34813dc30 :-1 s=OPENED pgs=309 cs=1 l=1).fault on lossy channel, failing 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: ms_handle_reset current mon v1:172.21.15.73:6789/0 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 >> v1:172.21.15.73:6789/0 conn(0x7fe3480a72f0 legacy=0x7fe34813dc30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient: _add_conns ranks=[0,1,3,4,7,8,6,5,2] 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): picked mon.a con 0x7fe3340037a0 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): picked mon.f con 0x7fe334004290 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): picked mon.g con 0x7fe33400c1f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:45.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe334003520 con 0x7fe3340037a0 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe34809ca00 con 0x7fe334004290 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe3480a7070 con 0x7fe33400c1f0 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.73:6789/0 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.008+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1248968829 0 0) 0x7fe334003520 con 0x7fe3340037a0 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.73:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fe334010100 con 0x7fe3340037a0 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820853987 0 0) 0x7fe3480a7070 con 0x7fe33400c1f0 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.203:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fe334003520 con 0x7fe33400c1f0 2024-09-11T02:02:45.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2081713121 0 0) 0x7fe334010100 con 0x7fe3340037a0 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 >> v1:172.21.15.203:6790/0 conn(0x7fe33400c1f0 legacy=0x7fe33400e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 >> v1:172.21.15.203:6789/0 conn(0x7fe334004290 legacy=0x7fe33400a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 monclient: found mon.a 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=2+}) -- 0x7fe334013360 con 0x7fe3340037a0 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3440018a0 con 0x7fe3340037a0 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:45.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient: dump: 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.027 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 1 -- 172.21.15.73:0/4014693072 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe344001a40 con 0x7fe3340037a0 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe33ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 4 set_mon_vals no callback set 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 10 monclient: shutdown 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 1 -- 172.21.15.73:0/4014693072 >> v1:172.21.15.73:6789/0 conn(0x7fe3340037a0 legacy=0x7fe334003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34df51640 1 -- 172.21.15.73:0/4014693072 reap_dead start 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 1 -- 172.21.15.73:0/4014693072 shutdown_connections 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 1 -- 172.21.15.73:0/4014693072 >> 172.21.15.73:0/4014693072 conn(0x7fe3480a8050 msgr2=0x7fe3480a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 1 -- 172.21.15.73:0/4014693072 shutdown_connections 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.009+0000 7fe34f9b4640 1 -- 172.21.15.73:0/4014693072 wait complete. 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.010+0000 7fe34f9b4640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.010+0000 7fe34f9b4640 10 monclient: monmap: 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.029 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.010+0000 7fe34f9b4640 1 Processor -- start 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.010+0000 7fe34f9b4640 1 -- start start 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.010+0000 7fe34f9b4640 10 monclient: init 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 10 monclient: _add_conns ranks=[3,7,1,4,5,6,0,2,8] 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 10 monclient(hunting): picked mon.noname-g con 0x7fe3340037a0 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 10 monclient(hunting): picked mon.noname-i con 0x7fe3480a01b0 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 10 monclient(hunting): picked mon.noname-f con 0x7fe3481d3510 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe348121e60 con 0x7fe3481d3510 2024-09-11T02:02:45.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3480aa100 con 0x7fe3340037a0 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3480a1ef0 con 0x7fe3480a01b0 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34f9b4640 10 monclient(hunting): authenticate will time out at 1006.615250s 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34d750640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7fe3340037a0 0x7fe34809faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.73:43864/0 (socket says 172.21.15.73:43864) 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe34d750640 1 -- 172.21.15.73:0/3509005743 learned_addr learned my addr 172.21.15.73:0/3509005743 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072281727 0 0) 0x7fe3480a1ef0 con 0x7fe3480a01b0 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): my global_id is 5722 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe32c003520 con 0x7fe3480a01b0 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405703551 0 0) 0x7fe3480aa100 con 0x7fe3340037a0 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): my global_id is 5781 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3480a1ef0 con 0x7fe3340037a0 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336354617 0 0) 0x7fe348121e60 con 0x7fe3481d3510 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): my global_id is 5572 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3480aa100 con 0x7fe3481d3510 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2921599509 0 0) 0x7fe32c003520 con 0x7fe3480a01b0 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe348121e60 con 0x7fe3480a01b0 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe338001790 con 0x7fe3480a01b0 2024-09-11T02:02:45.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): dump: 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.033 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 455397652 0 0) 0x7fe3480a1ef0 con 0x7fe3340037a0 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe32c003520 con 0x7fe3340037a0 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe344003950 con 0x7fe3340037a0 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): dump: 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.034 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3213269670 0 0) 0x7fe3480aa100 con 0x7fe3481d3510 2024-09-11T02:02:45.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3480a1ef0 con 0x7fe3481d3510 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3400016a0 con 0x7fe3481d3510 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.011+0000 7fe33dffb640 10 monclient(hunting): dump: 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.036 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 418672724 0 0) 0x7fe348121e60 con 0x7fe3480a01b0 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 >> v1:172.21.15.203:6790/0 conn(0x7fe3340037a0 legacy=0x7fe34809faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 >> v1:172.21.15.203:6789/0 conn(0x7fe3481d3510 legacy=0x7fe3481d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 1 monclient: found mon.i 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.203:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3480a1040 con 0x7fe3480a01b0 2024-09-11T02:02:45.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe34f9b4640 5 monclient: authenticate success, global_id 5722 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe34f9b4640 10 monclient: _renew_subs 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe34f9b4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.203:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe348122cb0 con 0x7fe3480a01b0 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.7 v1:172.21.15.203:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe338004a90 con 0x7fe3480a01b0 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.7 v1:172.21.15.203:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe338004f80 con 0x7fe3480a01b0 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33dffb640 10 monclient: dump: 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.038 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.039 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe34f9b4640 10 monclient: _renew_subs 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe33f7fe640 4 set_mon_vals no callback set 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe34f9b4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.012+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.203:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3480a1ba0 con 0x7fe3480a01b0 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe34f9b4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe348122650 con 0x7fe3480a2530 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.7 v1:172.21.15.203:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fe3380116c0 con 0x7fe3480a01b0 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.7 v1:172.21.15.203:6792/0 8 ==== osd_map(213..213 src has 1..213) ==== 3898+0+0 (unknown 1446247296 0 0) 0x7fe33804e3e0 con 0x7fe3480a01b0 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1695075525 0 0) 0x7fe348122650 con 0x7fe3480a2530 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 10 monclient(hunting): my global_id is 5719 2024-09-11T02:02:45.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe348121e60 con 0x7fe3480a2530 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe34df51640 10 monclient: get_auth_request con 0x7fe32c0406c0 auth_method 0 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2219012372 0 0) 0x7fe348121e60 con 0x7fe3480a2530 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe348122650 con 0x7fe3480a2530 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe344003af0 con 0x7fe3480a2530 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 10 monclient: dump: 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.041 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3382826364 0 0) 0x7fe348122650 con 0x7fe3480a2530 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.013+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3480008d0 con 0x7fe3480a2530 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.014+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe344003e60 con 0x7fe3480a2530 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.014+0000 7fe33dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.014+0000 7fe33dffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:45.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.014+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 >> v1:172.21.15.73:6791/0 conn(0x7fe3480a2530 legacy=0x7fe3480a2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.014+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 >> v1:172.21.15.73:6791/0 conn(0x7fe3480a2530 legacy=0x7fe3480a2910 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe34f9b4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:45.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe34813bbd0 con 0x7fe3480a3020 2024-09-11T02:02:45.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502413262 0 0) 0x7fe34813bbd0 con 0x7fe3480a3020 2024-09-11T02:02:45.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 10 monclient(hunting): my global_id is 5728 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe348122650 con 0x7fe3480a3020 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1715896841 0 0) 0x7fe348122650 con 0x7fe3480a3020 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe34813bbd0 con 0x7fe3480a3020 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3440057c0 con 0x7fe3480a3020 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 10 monclient: dump: 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.045 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 542483569 0 0) 0x7fe34813bbd0 con 0x7fe3480a3020 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.020+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 --> v1:172.21.15.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3480a3420 con 0x7fe3480a3020 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3850135422) 0x7fe344007aa0 con 0x7fe3480a3020 2024-09-11T02:02:45.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe33dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe33dffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 >> v1:172.21.15.73:6791/0 conn(0x7fe3480a3020 legacy=0x7fe3481db040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe33dffb640 1 -- 172.21.15.73:0/3509005743 >> v1:172.21.15.73:6791/0 conn(0x7fe3480a3020 legacy=0x7fe3481db040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 287483, 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:45.047 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:45.048 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.049 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:45.051 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.052 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:45.054 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.056 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:45.057 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.060 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.062 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.064 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:45.066 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:45.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 >> v1:172.21.15.203:6812/2311533528 conn(0x7fe32c0406c0 legacy=0x7fe32c042b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34f9b4640 10 monclient: shutdown 2024-09-11T02:02:45.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34f9b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 >> v1:172.21.15.203:6792/0 conn(0x7fe3480a01b0 legacy=0x7fe3480a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34df51640 1 -- 172.21.15.73:0/3509005743 reap_dead start 2024-09-11T02:02:45.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34df51640 1 -- 172.21.15.73:0/3509005743 reap_dead start 2024-09-11T02:02:45.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 shutdown_connections 2024-09-11T02:02:45.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 >> 172.21.15.73:0/3509005743 conn(0x7fe3480a8050 msgr2=0x7fe3481398f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 shutdown_connections 2024-09-11T02:02:45.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.021+0000 7fe34f9b4640 1 -- 172.21.15.73:0/3509005743 wait complete. 2024-09-11T02:02:45.068 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:45.068 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-11T02:02:45.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-11T02:02:45.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.166+0000 7f06286d4640 10 monclient: get_monmap_and_config 2024-09-11T02:02:45.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.166+0000 7f06286d4640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.166+0000 7f06286d4640 10 monclient: monmap: 2024-09-11T02:02:45.177 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.177 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.177 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:45.166885+0000 2024-09-11T02:02:45.177 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:45.166885+0000 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.166+0000 7f06286d4640 1 Processor -- start 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.166+0000 7f06286d4640 1 -- start start 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.166+0000 7f06286d4640 10 monclient: init 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 10 monclient: _add_conns ranks=[0,8,7,2,4,1,5,6,3] 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 10 monclient(hunting): picked mon.noname-a con 0x7f0620138d40 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 10 monclient(hunting): picked mon.noname-e con 0x7f06200a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 10 monclient(hunting): picked mon.noname-i con 0x7f062013f350 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062009ca00 con 0x7f0620138d40 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06200a7070 con 0x7f062013f350 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062009cee0 con 0x7f06200a72f0 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f06286d4640 10 monclient(hunting): authenticate will time out at 1006.771391s 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f0625c6f640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f06200a72f0 0x7f062013dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35322/0 (socket says 172.21.15.73:35322) 2024-09-11T02:02:45.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f0625c6f640 1 -- 172.21.15.73:0/1855553525 learned_addr learned my addr 172.21.15.73:0/1855553525 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f0626470640 1 --1- 172.21.15.73:0/1855553525 >> v1:172.21.15.73:6789/0 conn(0x7f0620138d40 0x7f0620139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47158/0 (socket says 172.21.15.73:47158) 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883253239 0 0) 0x7f062009ca00 con 0x7f0620138d40 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): my global_id is 5940 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f060c003520 con 0x7f0620138d40 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2112549046 0 0) 0x7f062009cee0 con 0x7f06200a72f0 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): my global_id is 114893 2024-09-11T02:02:45.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f062009ca00 con 0x7f06200a72f0 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285889846 0 0) 0x7f06200a7070 con 0x7f062013f350 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 10 monclient(hunting): my global_id is 5731 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f062009cee0 con 0x7f062013f350 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.167+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 145989038 0 0) 0x7f060c003520 con 0x7f0620138d40 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 >> v1:172.21.15.73:6793/0 conn(0x7f06200a72f0 legacy=0x7f062013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 >> v1:172.21.15.203:6792/0 conn(0x7f062013f350 legacy=0x7f0620141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 1 monclient: found mon.noname-a 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:02:45.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062009d1c0 con 0x7f0620138d40 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f061c001850 con 0x7f0620138d40 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 5 monclient: authenticate success, global_id 5940 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: dump: 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.182 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f061c0019f0 con 0x7f0620138d40 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 1 -- 172.21.15.73:0/1855553525 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f061c004b20 con 0x7f0620138d40 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 4 set_mon_vals no callback set 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f062546e640 10 monclient: dump: 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.184 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 10 monclient: shutdown 2024-09-11T02:02:45.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 1 -- 172.21.15.73:0/1855553525 >> v1:172.21.15.73:6789/0 conn(0x7f0620138d40 legacy=0x7f0620139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 1 -- 172.21.15.73:0/1855553525 shutdown_connections 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 1 -- 172.21.15.73:0/1855553525 >> 172.21.15.73:0/1855553525 conn(0x7f06200a8050 msgr2=0x7f06200a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 1 -- 172.21.15.73:0/1855553525 shutdown_connections 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.168+0000 7f06286d4640 1 -- 172.21.15.73:0/1855553525 wait complete. 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.169+0000 7f06286d4640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.169+0000 7f06286d4640 10 monclient: monmap: 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:45.186 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.169+0000 7f06286d4640 1 Processor -- start 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.169+0000 7f06286d4640 1 -- start start 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.169+0000 7f06286d4640 10 monclient: init 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 10 monclient: _add_conns ranks=[4,3,0,7,6,8,2,5,1] 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 10 monclient(hunting): picked mon.noname-c con 0x7f06200a72f0 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 10 monclient(hunting): picked mon.noname-g con 0x7f0620138d40 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 10 monclient(hunting): picked mon.noname-a con 0x7f062013f350 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062013e2d0 con 0x7f062013f350 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06200a1780 con 0x7f0620138d40 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06200a1a60 con 0x7f06200a72f0 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f06286d4640 10 monclient(hunting): authenticate will time out at 1006.774292s 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0626470640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f06200a72f0 0x7f062009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50660/0 (socket says 172.21.15.73:50660) 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0626470640 1 -- 172.21.15.73:0/3836180528 learned_addr learned my addr 172.21.15.73:0/3836180528 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532326238 0 0) 0x7f062009cee0 con 0x7f062013f350 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): my global_id is 5949 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0604003550 con 0x7f062013f350 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898146733 0 0) 0x7f06200a1a60 con 0x7f06200a72f0 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): my global_id is 5737 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f062009cee0 con 0x7f06200a72f0 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 819308693 0 0) 0x7f0604003550 con 0x7f062013f350 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06200a1a60 con 0x7f062013f350 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0618001d70 con 0x7f062013f350 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:02:45.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): dump: 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.190 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3603804374 0 0) 0x7f062009cee0 con 0x7f06200a72f0 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0604003550 con 0x7f06200a72f0 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f061c0013d0 con 0x7f06200a72f0 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): dump: 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.191 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775269271 0 0) 0x7f06200a1780 con 0x7f0620138d40 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient(hunting): my global_id is 5790 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f062009cee0 con 0x7f0620138d40 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3884119947 0 0) 0x7f06200a1a60 con 0x7f062013f350 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 >> v1:172.21.15.73:6791/0 conn(0x7f06200a72f0 legacy=0x7f062009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 >> v1:172.21.15.203:6790/0 conn(0x7f0620138d40 legacy=0x7f062009f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.170+0000 7f0616ffd640 1 monclient: found mon.a 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062013e9f0 con 0x7f062013f350 2024-09-11T02:02:45.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f06286d4640 5 monclient: authenticate success, global_id 5949 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f06286d4640 10 monclient: _renew_subs 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f06286d4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f062009fa60 con 0x7f062013f350 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f06286d4640 10 monclient: _renew_subs 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f06286d4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f062013e4d0 con 0x7f062013f350 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0618002010 con 0x7f062013f350 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0618004000 con 0x7f062013f350 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0624c6d640 4 set_mon_vals no callback set 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 10 monclient: dump: 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.195 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f06286d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f06080065c0 con 0x7f0608002860 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.171+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f06180107c0 con 0x7f062013f350 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(213..213 src has 1..213) ==== 3898+0+0 (unknown 1446247296 0 0) 0x7f061804d560 con 0x7f062013f350 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168150298 0 0) 0x7f06080065c0 con 0x7f0608002860 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 10 monclient(hunting): my global_id is 114882 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06200a1a60 con 0x7f0608002860 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0625c6f640 10 monclient: get_auth_request con 0x7f0604040440 auth_method 0 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3544218186 0 0) 0x7f06200a1a60 con 0x7f0608002860 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06080065c0 con 0x7f0608002860 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f061c004de0 con 0x7f0608002860 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 10 monclient: dump: 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.197 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1911205076 0 0) 0x7f06080065c0 con 0x7f0608002860 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f060800a160 con 0x7f0608002860 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f061c006330 con 0x7f0608002860 2024-09-11T02:02:45.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:45.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 >> v1:172.21.15.73:6792/0 conn(0x7f0608002860 legacy=0x7f0608004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.172+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 >> v1:172.21.15.73:6792/0 conn(0x7f0608002860 legacy=0x7f0608004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.178+0000 7f06286d4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:45.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0608009e70 con 0x7f0608009130 2024-09-11T02:02:45.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911644188 0 0) 0x7f0608009e70 con 0x7f0608009130 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 10 monclient(hunting): my global_id is 114891 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06080065c0 con 0x7f0608009130 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 514578941 0 0) 0x7f06080065c0 con 0x7f0608009130 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0608009e70 con 0x7f0608009130 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f061c0054a0 con 0x7f0608009130 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 10 monclient: dump: 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.201 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1019457274 0 0) 0x7f0608009e70 con 0x7f0608009130 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 --> v1:172.21.15.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f060800c3f0 con 0x7f0608009130 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 2602004558) 0x7f061c005780 con 0x7f0608009130 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 >> v1:172.21.15.73:6792/0 conn(0x7f0608009130 legacy=0x7f06080095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.179+0000 7f0616ffd640 1 -- 172.21.15.73:0/3836180528 >> v1:172.21.15.73:6792/0 conn(0x7f0608009130 legacy=0x7f06080095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:45.203 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 131768, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.205 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.206 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:45.207 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.208 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.209 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:45.210 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.213 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:45.214 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.215 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.216 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:45.217 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.218 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.220 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.221 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:45.222 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 >> v1:172.21.15.203:6812/2311533528 conn(0x7f0604040440 legacy=0x7f0604042900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f06286d4640 10 monclient: shutdown 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f06286d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 >> v1:172.21.15.73:6789/0 conn(0x7f062013f350 legacy=0x7f06201d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f0626c71640 1 -- 172.21.15.73:0/3836180528 reap_dead start 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f0626c71640 1 -- 172.21.15.73:0/3836180528 reap_dead start 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 shutdown_connections 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 >> 172.21.15.73:0/3836180528 conn(0x7f06200a8050 msgr2=0x7f0620131b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 shutdown_connections 2024-09-11T02:02:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.180+0000 7f06286d4640 1 -- 172.21.15.73:0/3836180528 wait complete. 2024-09-11T02:02:45.225 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:45.225 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-11T02:02:45.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-11T02:02:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.323+0000 7fc28f69b640 10 monclient: get_monmap_and_config 2024-09-11T02:02:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.323+0000 7fc28f69b640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.323+0000 7fc28f69b640 10 monclient: monmap: 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:45.324035+0000 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:45.324035+0000 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.326 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.323+0000 7fc28f69b640 1 Processor -- start 2024-09-11T02:02:45.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.323+0000 7fc28f69b640 1 -- start start 2024-09-11T02:02:45.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.323+0000 7fc28f69b640 10 monclient: init 2024-09-11T02:02:45.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 10 monclient: _add_conns ranks=[6,5,2,4,7,0,1,8,3] 2024-09-11T02:02:45.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 10 monclient(hunting): picked mon.noname-d con 0x7fc288138960 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:45.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 10 monclient(hunting): picked mon.noname-h con 0x7fc288139450 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 10 monclient(hunting): picked mon.noname-b con 0x7fc28813f620 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28809d030 con 0x7fc28813f620 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28809d310 con 0x7fc288139450 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28806f770 con 0x7fc288138960 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28f69b640 10 monclient(hunting): authenticate will time out at 1006.928478s 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28dc38640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fc28813f620 0x7fc288141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38610/0 (socket says 172.21.15.73:38610) 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28d437640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fc288138960 0x7fc288138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39906/0 (socket says 172.21.15.73:39906) 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc28dc38640 1 -- 172.21.15.73:0/2684642652 learned_addr learned my addr 172.21.15.73:0/2684642652 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024151704 0 0) 0x7fc28809d030 con 0x7fc28813f620 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 10 monclient(hunting): my global_id is 134120 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc274003520 con 0x7fc28813f620 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327879309 0 0) 0x7fc28806f770 con 0x7fc288138960 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 10 monclient(hunting): my global_id is 114900 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc28809d030 con 0x7fc288138960 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.324+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3058116824 0 0) 0x7fc274003520 con 0x7fc28813f620 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 >> v1:172.21.15.73:6792/0 conn(0x7fc288138960 legacy=0x7fc288138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 >> v1:172.21.15.203:6791/0 conn(0x7fc288139450 legacy=0x7fc28813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 1 monclient: found mon.noname-b 2024-09-11T02:02:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2880a7360 con 0x7fc28813f620 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc280001bb0 con 0x7fc28813f620 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 5 monclient: authenticate success, global_id 134120 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: dump: 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc280001dd0 con 0x7fc28813f620 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 4 set_mon_vals no callback set 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 1 -- 172.21.15.73:0/2684642652 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc2800020c0 con 0x7fc28813f620 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc27ffff640 10 monclient: dump: 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.338 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 10 monclient: shutdown 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 1 -- 172.21.15.73:0/2684642652 >> v1:172.21.15.73:6790/0 conn(0x7fc28813f620 legacy=0x7fc288141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 1 -- 172.21.15.73:0/2684642652 shutdown_connections 2024-09-11T02:02:45.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 1 -- 172.21.15.73:0/2684642652 >> 172.21.15.73:0/2684642652 conn(0x7fc2880a8050 msgr2=0x7fc2880a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 1 -- 172.21.15.73:0/2684642652 shutdown_connections 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.325+0000 7fc28f69b640 1 -- 172.21.15.73:0/2684642652 wait complete. 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.326+0000 7fc28f69b640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.326+0000 7fc28f69b640 10 monclient: monmap: 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.340 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.326+0000 7fc28f69b640 1 Processor -- start 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.326+0000 7fc28f69b640 1 -- start start 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.326+0000 7fc28f69b640 10 monclient: init 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 10 monclient: _add_conns ranks=[3,5,8,1,7,2,0,6,4] 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 10 monclient(hunting): picked mon.noname-g con 0x7fc288138960 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 10 monclient(hunting): picked mon.noname-h con 0x7fc288139450 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:45.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 10 monclient(hunting): picked mon.noname-e con 0x7fc28813f620 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28813f1c0 con 0x7fc288138960 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28813c210 con 0x7fc288139450 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28813c4f0 con 0x7fc28813f620 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 10 monclient(hunting): authenticate will time out at 1006.931156s 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28dc38640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fc28813f620 0x7fc2881d5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35334/0 (socket says 172.21.15.73:35334) 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28dc38640 1 -- 172.21.15.73:0/3289467834 learned_addr learned my addr 172.21.15.73:0/3289467834 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521839789 0 0) 0x7fc28813c4f0 con 0x7fc28813f620 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): my global_id is 114902 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc26c003520 con 0x7fc28813f620 2024-09-11T02:02:45.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762627165 0 0) 0x7fc284001a90 con 0x7fc288138960 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): my global_id is 5799 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc28813c4f0 con 0x7fc288138960 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940408555 0 0) 0x7fc28813c210 con 0x7fc288139450 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): my global_id is 5954 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc284001a90 con 0x7fc288139450 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3611339350 0 0) 0x7fc26c003520 con 0x7fc28813f620 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc28813c210 con 0x7fc28813f620 2024-09-11T02:02:45.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc280001f80 con 0x7fc28813f620 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): dump: 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.344 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1847136505 0 0) 0x7fc28813c210 con 0x7fc28813f620 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 >> v1:172.21.15.203:6791/0 conn(0x7fc288139450 legacy=0x7fc28813a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 >> v1:172.21.15.203:6790/0 conn(0x7fc288138960 legacy=0x7fc288139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 monclient: found mon.e 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28813aaf0 con 0x7fc28813f620 2024-09-11T02:02:45.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 5 monclient: authenticate success, global_id 114902 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 10 monclient: _renew_subs 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.327+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc288142b50 con 0x7fc28813f620 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc280005150 con 0x7fc28813f620 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc27dffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc280005640 con 0x7fc28813f620 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc27dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc27dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc27dffb640 10 monclient: dump: 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc27f7fe640 4 set_mon_vals no callback set 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc28f69b640 10 monclient: _renew_subs 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc28f69b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fc28813bf30 con 0x7fc28813f620 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fc280011d80 con 0x7fc28813f620 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc28f69b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.328+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc28813e700 con 0x7fc288143130 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(213..213 src has 1..213) ==== 3898+0+0 (unknown 1446247296 0 0) 0x7fc28004e5d0 con 0x7fc28813f620 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3772868090 0 0) 0x7fc28813e700 con 0x7fc288143130 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 10 monclient(hunting): my global_id is 114911 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc28813c210 con 0x7fc288143130 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc28cc36640 10 monclient: get_auth_request con 0x7fc26c03fdb0 auth_method 0 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 785618108 0 0) 0x7fc28813c210 con 0x7fc288143130 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc28813e700 con 0x7fc288143130 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc284004d10 con 0x7fc288143130 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 10 monclient: dump: 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.349 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 999814225 0 0) 0x7fc28813e700 con 0x7fc288143130 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2880008d0 con 0x7fc288143130 2024-09-11T02:02:45.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc2840070b0 con 0x7fc288143130 2024-09-11T02:02:45.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:45.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 >> v1:172.21.15.73:6793/0 conn(0x7fc288143130 legacy=0x7fc288140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.329+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 >> v1:172.21.15.73:6793/0 conn(0x7fc288143130 legacy=0x7fc288140a10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.335+0000 7fc28f69b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:45.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.335+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc2880a11d0 con 0x7fc28802e450 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307816262 0 0) 0x7fc2880a11d0 con 0x7fc28802e450 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 10 monclient(hunting): my global_id is 114920 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc28813e700 con 0x7fc28802e450 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1008363796 0 0) 0x7fc28813e700 con 0x7fc28802e450 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2880a11d0 con 0x7fc28802e450 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fc284005710 con 0x7fc28802e450 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 10 monclient: dump: 2024-09-11T02:02:45.353 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.354 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2681326916 0 0) 0x7fc2880a11d0 con 0x7fc28802e450 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 --> v1:172.21.15.73:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc28802e830 con 0x7fc28802e450 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 1438559155) 0x7fc28400a0c0 con 0x7fc28802e450 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 >> v1:172.21.15.73:6793/0 conn(0x7fc28802e450 legacy=0x7fc288141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.336+0000 7fc27dffb640 1 -- 172.21.15.73:0/3289467834 >> v1:172.21.15.73:6793/0 conn(0x7fc28802e450 legacy=0x7fc288141120 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:45.355 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 131925, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:45.356 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.357 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.358 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.359 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.360 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:45.361 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.362 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.363 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.365 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.368 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.370 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.371 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.373 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.374 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.375 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T02:02:45.375 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.375 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.375 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:45.375 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 >> v1:172.21.15.203:6812/2311533528 conn(0x7fc26c03fdb0 legacy=0x7fc26c042270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28f69b640 10 monclient: shutdown 2024-09-11T02:02:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28f69b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 >> v1:172.21.15.73:6793/0 conn(0x7fc28813f620 legacy=0x7fc2881d5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28dc38640 1 -- 172.21.15.73:0/3289467834 reap_dead start 2024-09-11T02:02:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28dc38640 1 -- 172.21.15.73:0/3289467834 reap_dead start 2024-09-11T02:02:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 shutdown_connections 2024-09-11T02:02:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 >> 172.21.15.73:0/3289467834 conn(0x7fc2880a8050 msgr2=0x7fc2880a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 shutdown_connections 2024-09-11T02:02:45.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.337+0000 7fc28f69b640 1 -- 172.21.15.73:0/3289467834 wait complete. 2024-09-11T02:02:45.377 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:45.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-11T02:02:45.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-11T02:02:45.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.475+0000 7f2bf7671640 10 monclient: get_monmap_and_config 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.475+0000 7f2bf7671640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.475+0000 7f2bf7671640 10 monclient: monmap: 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:45.476108+0000 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:45.476108+0000 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.477 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.478 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.478 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.478 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.478 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.478 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.478 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.478 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.475+0000 7f2bf7671640 1 Processor -- start 2024-09-11T02:02:45.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 1 -- start start 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 10 monclient: init 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 10 monclient: _add_conns ranks=[6,5,8,7,3,4,1,2,0] 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 10 monclient(hunting): picked mon.noname-d con 0x7f2bf006dc60 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 10 monclient(hunting): picked mon.noname-h con 0x7f2bf00a1890 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 10 monclient(hunting): picked mon.noname-e con 0x7f2bf006e750 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf00a5880 con 0x7f2bf00a1890 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf006ef40 con 0x7f2bf006dc60 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf00a0610 con 0x7f2bf006e750 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf7671640 10 monclient(hunting): authenticate will time out at 1007.080731s 2024-09-11T02:02:45.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf540d640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f2bf006dc60 0x7f2bf006e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39918/0 (socket says 172.21.15.73:39918) 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.476+0000 7f2bf540d640 1 -- 172.21.15.73:0/99753528 learned_addr learned my addr 172.21.15.73:0/99753528 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188422959 0 0) 0x7f2bf00a0610 con 0x7f2bf006e750 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): my global_id is 114929 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bdc003520 con 0x7f2bf006e750 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143962502 0 0) 0x7f2bf006ef40 con 0x7f2bf006dc60 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): my global_id is 114909 2024-09-11T02:02:45.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf00a0610 con 0x7f2bf006dc60 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362631056 0 0) 0x7f2bf00a5880 con 0x7f2bf00a1890 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient(hunting): my global_id is 5963 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf006ef40 con 0x7f2bf00a1890 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2285182232 0 0) 0x7f2bf00a0610 con 0x7f2bf006dc60 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 >> v1:172.21.15.73:6793/0 conn(0x7f2bf006e750 legacy=0x7f2bf01414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 >> v1:172.21.15.203:6791/0 conn(0x7f2bf00a1890 legacy=0x7f2bf013dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 monclient: found mon.noname-d 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf00a08f0 con 0x7f2bf006dc60 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2bec001810 con 0x7f2bf006dc60 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: dump: 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.490 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2bf7671640 5 monclient: authenticate success, global_id 114909 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2bf7671640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2bec0019b0 con 0x7f2bf006dc60 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 1 -- 172.21.15.73:0/99753528 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2bec004be0 con 0x7f2bf006dc60 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2bf7671640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2bf7671640 4 set_mon_vals no callback set 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2be7fff640 10 monclient: dump: 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.492 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2bf7671640 10 monclient: shutdown 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2bf7671640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2bf7671640 1 -- 172.21.15.73:0/99753528 >> v1:172.21.15.73:6792/0 conn(0x7f2bf006dc60 legacy=0x7f2bf006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2bf7671640 1 -- 172.21.15.73:0/99753528 shutdown_connections 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.477+0000 7f2bf7671640 1 -- 172.21.15.73:0/99753528 >> 172.21.15.73:0/99753528 conn(0x7f2bf00a5aa0 msgr2=0x7f2bf00a5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.478+0000 7f2bf7671640 1 -- 172.21.15.73:0/99753528 shutdown_connections 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.478+0000 7f2bf7671640 1 -- 172.21.15.73:0/99753528 wait complete. 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.478+0000 7f2bf7671640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.478+0000 7f2bf7671640 10 monclient: monmap: 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.494 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.478+0000 7f2bf7671640 1 Processor -- start 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.478+0000 7f2bf7671640 1 -- start start 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.478+0000 7f2bf7671640 10 monclient: init 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 10 monclient: _add_conns ranks=[4,5,7,3,8,0,6,1,2] 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 10 monclient(hunting): picked mon.noname-c con 0x7f2bf006dc60 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 10 monclient(hunting): picked mon.noname-h con 0x7f2bf006e750 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 10 monclient(hunting): picked mon.noname-i con 0x7f2bf00a1890 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf0127ad0 con 0x7f2bf006dc60 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf009eec0 con 0x7f2bf006e750 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf00a4280 con 0x7f2bf00a1890 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf7671640 10 monclient(hunting): authenticate will time out at 1007.083455s 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf540d640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f2bf006dc60 0x7f2bf0125190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50676/0 (socket says 172.21.15.73:50676) 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2bf540d640 1 -- 172.21.15.73:0/329253535 learned_addr learned my addr 172.21.15.73:0/329253535 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931755921 0 0) 0x7f2bf0127ad0 con 0x7f2bf006dc60 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): my global_id is 5746 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bd4003520 con 0x7f2bf006dc60 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824602556 0 0) 0x7f2bf009eec0 con 0x7f2bf006e750 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): my global_id is 5972 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf0127ad0 con 0x7f2bf006e750 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241937231 0 0) 0x7f2bf00a4280 con 0x7f2bf00a1890 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): my global_id is 5740 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf009eec0 con 0x7f2bf00a1890 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3868654210 0 0) 0x7f2bd4003520 con 0x7f2bf006dc60 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bf00a4280 con 0x7f2bf006dc60 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2bec0016d0 con 0x7f2bf006dc60 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.479+0000 7f2be5ffb640 10 monclient(hunting): dump: 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.498 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 303402443 0 0) 0x7f2bf009eec0 con 0x7f2bf00a1890 2024-09-11T02:02:45.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bd4003520 con 0x7f2bf00a1890 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3566843150 0 0) 0x7f2bf0127ad0 con 0x7f2bf006e750 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bf009eec0 con 0x7f2bf006e750 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2be8001680 con 0x7f2bf00a1890 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient(hunting): dump: 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.500 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 718848266 0 0) 0x7f2bf00a4280 con 0x7f2bf006dc60 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 >> v1:172.21.15.203:6792/0 conn(0x7f2bf00a1890 legacy=0x7f2bf0125fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 >> v1:172.21.15.203:6791/0 conn(0x7f2bf006e750 legacy=0x7f2bf01258a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 monclient: found mon.c 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf0128c20 con 0x7f2bf006dc60 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2bf7671640 5 monclient: authenticate success, global_id 5746 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2bf7671640 10 monclient: _renew_subs 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2bf7671640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf0128f00 con 0x7f2bf006dc60 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2bec004ea0 con 0x7f2bf006dc60 2024-09-11T02:02:45.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2bec005390 con 0x7f2bf006dc60 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be5ffb640 10 monclient: dump: 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.503 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2bf7671640 10 monclient: _renew_subs 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2bf7671640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2be77fe640 4 set_mon_vals no callback set 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.480+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2bf01d6b30 con 0x7f2bf006dc60 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f2bec011ad0 con 0x7f2bf006dc60 2024-09-11T02:02:45.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2bf7671640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2bf00008d0 con 0x7f2bf002e5c0 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(213..213 src has 1..213) ==== 3898+0+0 (unknown 1446247296 0 0) 0x7f2bec04e400 con 0x7f2bf006dc60 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2bf5c0e640 10 monclient: get_auth_request con 0x7f2bd4040560 auth_method 0 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737101574 0 0) 0x7f2bf00008d0 con 0x7f2bf002e5c0 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 10 monclient(hunting): my global_id is 5581 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf00a4280 con 0x7f2bf002e5c0 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 763943769 0 0) 0x7f2bf00a4280 con 0x7f2bf002e5c0 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bf00008d0 con 0x7f2bf002e5c0 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2be0003950 con 0x7f2bf002e5c0 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.481+0000 7f2be5ffb640 10 monclient: dump: 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.482+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 964259119 0 0) 0x7f2bf00008d0 con 0x7f2bf002e5c0 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.482+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bf002e9a0 con 0x7f2bf002e5c0 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.482+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2be0004640 con 0x7f2bf002e5c0 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.482+0000 7f2be5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.482+0000 7f2be5ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.482+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 >> v1:172.21.15.203:6789/0 conn(0x7f2bf002e5c0 legacy=0x7f2bf0063d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.482+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 >> v1:172.21.15.203:6789/0 conn(0x7f2bf002e5c0 legacy=0x7f2bf0063d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.488+0000 7f2bf7671640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.488+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2bf0064460 con 0x7f2bf0073230 2024-09-11T02:02:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078382828 0 0) 0x7f2bf0064460 con 0x7f2bf0073230 2024-09-11T02:02:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 10 monclient(hunting): my global_id is 5590 2024-09-11T02:02:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf00008d0 con 0x7f2bf0073230 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1523501428 0 0) 0x7f2bf00008d0 con 0x7f2bf0073230 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2bf0064460 con 0x7f2bf0073230 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2be0004230 con 0x7f2bf0073230 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 10 monclient: dump: 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4074589947 0 0) 0x7f2bf0064460 con 0x7f2bf0073230 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 --> v1:172.21.15.203:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2bf01de5d0 con 0x7f2bf0073230 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7880 (unknown 0 0 536646537) 0x7f2be00047f0 con 0x7f2bf0073230 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:45.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 >> v1:172.21.15.203:6789/0 conn(0x7f2bf0073230 legacy=0x7f2bf01dad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.489+0000 7f2be5ffb640 1 -- 172.21.15.73:0/329253535 >> v1:172.21.15.203:6789/0 conn(0x7f2bf0073230 legacy=0x7f2bf01dad20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 287905, 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:45.512 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:45.513 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.514 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:45.516 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.517 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.518 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:45.519 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.520 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.522 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:45.523 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.524 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.527 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.528 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.529 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.530 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.531 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.533 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:45.533 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 >> v1:172.21.15.203:6812/2311533528 conn(0x7f2bd4040560 legacy=0x7f2bd4042a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf7671640 10 monclient: shutdown 2024-09-11T02:02:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf7671640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 >> v1:172.21.15.73:6791/0 conn(0x7f2bf006dc60 legacy=0x7f2bf0125190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf5c0e640 1 -- 172.21.15.73:0/329253535 reap_dead start 2024-09-11T02:02:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf5c0e640 1 -- 172.21.15.73:0/329253535 reap_dead start 2024-09-11T02:02:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 shutdown_connections 2024-09-11T02:02:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 >> 172.21.15.73:0/329253535 conn(0x7f2bf00a5aa0 msgr2=0x7f2bf0142190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 shutdown_connections 2024-09-11T02:02:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.490+0000 7f2bf7671640 1 -- 172.21.15.73:0/329253535 wait complete. 2024-09-11T02:02:45.535 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:45.535 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-11T02:02:45.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-11T02:02:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.631+0000 7f7bd7e16640 10 monclient: get_monmap_and_config 2024-09-11T02:02:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.631+0000 7f7bd7e16640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.631+0000 7f7bd7e16640 10 monclient: monmap: 2024-09-11T02:02:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:45.632412+0000 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:45.632412+0000 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.635 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 1 Processor -- start 2024-09-11T02:02:45.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 1 -- start start 2024-09-11T02:02:45.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 10 monclient: init 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 10 monclient: _add_conns ranks=[3,1,8,0,5,6,4,2,7] 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 10 monclient(hunting): picked mon.noname-g con 0x7f7bd00a5b30 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 10 monclient(hunting): picked mon.noname-f con 0x7f7bd00a6620 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 10 monclient(hunting): picked mon.noname-e con 0x7f7bd009db70 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd00a7490 con 0x7f7bd00a6620 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd009ca00 con 0x7f7bd00a5b30 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd006fbf0 con 0x7f7bd009db70 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd7e16640 10 monclient(hunting): authenticate will time out at 1007.236809s 2024-09-11T02:02:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd63b3640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f7bd009db70 0x7f7bd0141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35370/0 (socket says 172.21.15.73:35370) 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.632+0000 7f7bd63b3640 1 -- 172.21.15.73:0/712195818 learned_addr learned my addr 172.21.15.73:0/712195818 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 -- 172.21.15.73:0/712195818 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767131164 0 0) 0x7f7bd006fbf0 con 0x7f7bd009db70 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient(hunting): my global_id is 114938 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 -- 172.21.15.73:0/712195818 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bb8003520 con 0x7f7bd009db70 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 -- 172.21.15.73:0/712195818 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2446129744 0 0) 0x7f7bb8003520 con 0x7f7bd009db70 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 -- 172.21.15.73:0/712195818 >> v1:172.21.15.203:6790/0 conn(0x7f7bd00a5b30 legacy=0x7f7bd00a5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 -- 172.21.15.73:0/712195818 >> v1:172.21.15.203:6789/0 conn(0x7f7bd00a6620 legacy=0x7f7bd013dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 monclient: found mon.noname-e 2024-09-11T02:02:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 -- 172.21.15.73:0/712195818 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd009ceb0 con 0x7f7bd009db70 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 -- 172.21.15.73:0/712195818 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7bc8001850 con 0x7f7bd009db70 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd7e16640 5 monclient: authenticate success, global_id 114938 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd7e16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: dump: 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd7e16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 -- 172.21.15.73:0/712195818 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bc8001a70 con 0x7f7bd009db70 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 1 -- 172.21.15.73:0/712195818 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7bc8004be0 con 0x7f7bd009db70 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd7e16640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd7e16640 4 set_mon_vals no callback set 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd4bb0640 10 monclient: dump: 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd7e16640 10 monclient: shutdown 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd7e16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.633+0000 7f7bd7e16640 1 -- 172.21.15.73:0/712195818 >> v1:172.21.15.73:6793/0 conn(0x7f7bd009db70 legacy=0x7f7bd0141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.634+0000 7f7bd7e16640 1 -- 172.21.15.73:0/712195818 shutdown_connections 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.634+0000 7f7bd7e16640 1 -- 172.21.15.73:0/712195818 >> 172.21.15.73:0/712195818 conn(0x7f7bd00abe30 msgr2=0x7f7bd00a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.634+0000 7f7bd7e16640 1 -- 172.21.15.73:0/712195818 shutdown_connections 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.634+0000 7f7bd7e16640 1 -- 172.21.15.73:0/712195818 wait complete. 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.634+0000 7f7bd7e16640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.634+0000 7f7bd7e16640 10 monclient: monmap: 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.634+0000 7f7bd7e16640 1 Processor -- start 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 1 -- start start 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 10 monclient: init 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 10 monclient: _add_conns ranks=[6,3,7,5,2,1,8,4,0] 2024-09-11T02:02:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 10 monclient(hunting): picked mon.noname-d con 0x7f7bd00a5b30 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 10 monclient(hunting): picked mon.noname-g con 0x7f7bd00a6620 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 10 monclient(hunting): picked mon.noname-i con 0x7f7bd0125320 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd0127d30 con 0x7f7bd00a6620 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd0141950 con 0x7f7bd00a5b30 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd0126840 con 0x7f7bd0125320 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd7e16640 10 monclient(hunting): authenticate will time out at 1007.239543s 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd5bb2640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f7bd00a5b30 0x7f7bd0141240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39920/0 (socket says 172.21.15.73:39920) 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bd5bb2640 1 -- 172.21.15.73:0/1605928294 learned_addr learned my addr 172.21.15.73:0/1605928294 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3410480924 0 0) 0x7f7bd0141950 con 0x7f7bd00a5b30 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): my global_id is 114918 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bbc003520 con 0x7f7bd00a5b30 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472493360 0 0) 0x7f7bd0127d30 con 0x7f7bd00a6620 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): my global_id is 5817 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bd0141950 con 0x7f7bd00a6620 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209006955 0 0) 0x7f7bd0126840 con 0x7f7bd0125320 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 10 monclient(hunting): my global_id is 5749 2024-09-11T02:02:45.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bd0127d30 con 0x7f7bd0125320 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.635+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3675944407 0 0) 0x7f7bbc003520 con 0x7f7bd00a5b30 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bd0126840 con 0x7f7bd00a5b30 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7bc0001e50 con 0x7f7bd00a5b30 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient(hunting): dump: 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.653 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1975952076 0 0) 0x7f7bd0141950 con 0x7f7bd00a6620 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bbc003520 con 0x7f7bd00a6620 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7bc4001930 con 0x7f7bd00a6620 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient(hunting): dump: 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3024207484 0 0) 0x7f7bd0126840 con 0x7f7bd00a5b30 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 >> v1:172.21.15.203:6792/0 conn(0x7f7bd0125320 legacy=0x7f7bd01d5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 >> v1:172.21.15.203:6790/0 conn(0x7f7bd00a6620 legacy=0x7f7bd01d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 monclient: found mon.d 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd0128ba0 con 0x7f7bd00a5b30 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bd7e16640 5 monclient: authenticate success, global_id 114918 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bd7e16640 10 monclient: _renew_subs 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bd7e16640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd0128300 con 0x7f7bd00a5b30 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bd7e16640 10 monclient: _renew_subs 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bd7e16640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f7bd0127580 con 0x7f7bd00a5b30 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bc0003c40 con 0x7f7bd00a5b30 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7bc00041f0 con 0x7f7bd00a5b30 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bcffff640 4 set_mon_vals no callback set 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.636+0000 7f7bce7fc640 10 monclient: dump: 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.658 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bd7e16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7bb00065c0 con 0x7f7bb0002860 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f7bc0004410 con 0x7f7bd00a5b30 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(213..213 src has 1..213) ==== 3898+0+0 (unknown 1446247296 0 0) 0x7f7bc004e790 con 0x7f7bd00a5b30 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3055179456 0 0) 0x7f7bb00065c0 con 0x7f7bb0002860 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 10 monclient(hunting): my global_id is 5826 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bd0126840 con 0x7f7bb0002860 2024-09-11T02:02:45.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bd63b3640 10 monclient: get_auth_request con 0x7f7bbc040470 auth_method 0 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1885876618 0 0) 0x7f7bd0126840 con 0x7f7bb0002860 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bb00065c0 con 0x7f7bb0002860 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7bc4003950 con 0x7f7bb0002860 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 10 monclient: dump: 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.660 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1986559025 0 0) 0x7f7bb00065c0 con 0x7f7bb0002860 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.637+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bb000a160 con 0x7f7bb0002860 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.638+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7bc4003d50 con 0x7f7bb0002860 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.638+0000 7f7bce7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.638+0000 7f7bce7fc640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:45.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.638+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 >> v1:172.21.15.203:6790/0 conn(0x7f7bb0002860 legacy=0x7f7bb0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.638+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 >> v1:172.21.15.203:6790/0 conn(0x7f7bb0002860 legacy=0x7f7bb0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.644+0000 7f7bd7e16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.644+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7bb0009e70 con 0x7f7bb0009130 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.644+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2468462620 0 0) 0x7f7bb0009e70 con 0x7f7bb0009130 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.644+0000 7f7bce7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.644+0000 7f7bce7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.644+0000 7f7bce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.644+0000 7f7bce7fc640 10 monclient(hunting): my global_id is 5835 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.644+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bb00065c0 con 0x7f7bb0009130 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2662519217 0 0) 0x7f7bb00065c0 con 0x7f7bb0009130 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bb0009e70 con 0x7f7bb0009130 2024-09-11T02:02:45.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7bc40044b0 con 0x7f7bb0009130 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 10 monclient: dump: 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.665 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.666 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.666 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.666 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.666 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 595497450 0 0) 0x7f7bb0009e70 con 0x7f7bb0009130 2024-09-11T02:02:45.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 --> v1:172.21.15.203:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7bb000c410 con 0x7f7bb0009130 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 2179472902) 0x7f7bc4005980 con 0x7f7bb0009130 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 >> v1:172.21.15.203:6790/0 conn(0x7f7bb0009130 legacy=0x7f7bb00095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bce7fc640 1 -- 172.21.15.73:0/1605928294 >> v1:172.21.15.203:6790/0 conn(0x7f7bb0009130 legacy=0x7f7bb00095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:45.667 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 288083, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.668 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.669 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.670 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:45.671 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:45.671 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:45.671 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:45.671 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:45.671 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:45.671 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.671 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.671 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:45.671 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.672 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.675 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.676 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:45.677 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.679 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.680 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.681 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.681 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.681 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.681 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.681 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.681 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.681 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.681 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.682 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.683 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.684 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.685 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:02:45.686 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:45.687 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 >> v1:172.21.15.203:6812/2311533528 conn(0x7f7bbc040470 legacy=0x7f7bbc042930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bd7e16640 10 monclient: shutdown 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bd7e16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 >> v1:172.21.15.73:6792/0 conn(0x7f7bd00a5b30 legacy=0x7f7bd0141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.645+0000 7f7bd63b3640 1 -- 172.21.15.73:0/1605928294 reap_dead start 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.646+0000 7f7bd63b3640 1 -- 172.21.15.73:0/1605928294 reap_dead start 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.646+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 shutdown_connections 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.646+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 >> 172.21.15.73:0/1605928294 conn(0x7f7bd009db70 msgr2=0x7f7bd00a3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.646+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 shutdown_connections 2024-09-11T02:02:45.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.646+0000 7f7bd7e16640 1 -- 172.21.15.73:0/1605928294 wait complete. 2024-09-11T02:02:45.690 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:45.690 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-11T02:02:45.690 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-11T02:02:45.726 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:45.726 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38208]: starting. 2024-09-11T02:02:45.727 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38208]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38170 2024-09-11T02:02:45.727 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38208]: shutting down. 2024-09-11T02:02:45.728 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:45.728 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:02:45.728 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:02:45.730 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:02:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.792+0000 7fd05e8dd640 10 monclient: get_monmap_and_config 2024-09-11T02:02:45.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.792+0000 7fd05e8dd640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.792+0000 7fd05e8dd640 10 monclient: monmap: 2024-09-11T02:02:45.794 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.794 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.794 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:45.793383+0000 2024-09-11T02:02:45.794 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:45.793383+0000 2024-09-11T02:02:45.794 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.794 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.794 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.795 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 1 Processor -- start 2024-09-11T02:02:45.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 1 -- start start 2024-09-11T02:02:45.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 10 monclient: init 2024-09-11T02:02:45.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 10 monclient: _add_conns ranks=[2,5,7,1,3,0,6,4,8] 2024-09-11T02:02:45.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 10 monclient(hunting): picked mon.noname-b con 0x7fd058138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 10 monclient(hunting): picked mon.noname-h con 0x7fd0580a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 10 monclient(hunting): picked mon.noname-i con 0x7fd05813f350 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05809ca00 con 0x7fd058138d40 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0580a7070 con 0x7fd0580a72f0 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05809cee0 con 0x7fd05813f350 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd05e8dd640 10 monclient(hunting): authenticate will time out at 1007.397822s 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd057fff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fd058138d40 0x7fd058139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38614/0 (socket says 172.21.15.73:38614) 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.793+0000 7fd057fff640 1 -- 172.21.15.73:0/2190885844 learned_addr learned my addr 172.21.15.73:0/2190885844 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608783757 0 0) 0x7fd05809ca00 con 0x7fd058138d40 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): my global_id is 134147 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd044003520 con 0x7fd058138d40 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984840469 0 0) 0x7fd05809cee0 con 0x7fd05813f350 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): my global_id is 5785 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd05809ca00 con 0x7fd05813f350 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829401014 0 0) 0x7fd0580a7070 con 0x7fd0580a72f0 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient(hunting): my global_id is 5981 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd05809cee0 con 0x7fd0580a72f0 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2388568194 0 0) 0x7fd044003520 con 0x7fd058138d40 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 >> v1:172.21.15.203:6792/0 conn(0x7fd05813f350 legacy=0x7fd058141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 >> v1:172.21.15.203:6791/0 conn(0x7fd0580a72f0 legacy=0x7fd05813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 monclient: found mon.noname-b 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05809d1c0 con 0x7fd058138d40 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd048001850 con 0x7fd058138d40 2024-09-11T02:02:45.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 5 monclient: authenticate success, global_id 134147 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: dump: 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.810 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd048001a70 con 0x7fd058138d40 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 1 -- 172.21.15.73:0/2190885844 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd048004be0 con 0x7fd058138d40 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 4 set_mon_vals no callback set 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd056ffd640 10 monclient: dump: 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.812 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 10 monclient: shutdown 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 1 -- 172.21.15.73:0/2190885844 >> v1:172.21.15.73:6790/0 conn(0x7fd058138d40 legacy=0x7fd058139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 1 -- 172.21.15.73:0/2190885844 shutdown_connections 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.794+0000 7fd05e8dd640 1 -- 172.21.15.73:0/2190885844 >> 172.21.15.73:0/2190885844 conn(0x7fd0580a8050 msgr2=0x7fd0580a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.795+0000 7fd05e8dd640 1 -- 172.21.15.73:0/2190885844 shutdown_connections 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.795+0000 7fd05e8dd640 1 -- 172.21.15.73:0/2190885844 wait complete. 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.795+0000 7fd05e8dd640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.795+0000 7fd05e8dd640 10 monclient: monmap: 2024-09-11T02:02:45.813 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.814 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.795+0000 7fd05e8dd640 1 Processor -- start 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 1 -- start start 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 10 monclient: init 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 10 monclient: _add_conns ranks=[1,4,0,2,7,8,3,6,5] 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 10 monclient(hunting): picked mon.noname-f con 0x7fd0580a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 10 monclient(hunting): picked mon.noname-c con 0x7fd058138d40 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 10 monclient(hunting): picked mon.noname-a con 0x7fd05813f350 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0580a52f0 con 0x7fd05813f350 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd058140550 con 0x7fd0580a72f0 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05813ea30 con 0x7fd058138d40 2024-09-11T02:02:45.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd05e8dd640 10 monclient(hunting): authenticate will time out at 1007.400642s 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd0577fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fd058138d40 0x7fd05813fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50680/0 (socket says 172.21.15.73:50680) 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd0577fe640 1 -- 172.21.15.73:0/1008636125 learned_addr learned my addr 172.21.15.73:0/1008636125 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433573720 0 0) 0x7fd05813ea30 con 0x7fd058138d40 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 10 monclient(hunting): my global_id is 5764 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd038003550 con 0x7fd058138d40 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888738474 0 0) 0x7fd05809ca00 con 0x7fd05813f350 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 10 monclient(hunting): my global_id is 5967 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.796+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd05813ea30 con 0x7fd05813f350 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1033788084 0 0) 0x7fd058140550 con 0x7fd0580a72f0 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): my global_id is 5626 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd05809ca00 con 0x7fd0580a72f0 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4108923137 0 0) 0x7fd038003550 con 0x7fd058138d40 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd058140550 con 0x7fd058138d40 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd040001ad0 con 0x7fd058138d40 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): dump: 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.818 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2843701804 0 0) 0x7fd05813ea30 con 0x7fd05813f350 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd038003550 con 0x7fd05813f350 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd050001bb0 con 0x7fd05813f350 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient(hunting): dump: 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.819 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1841804565 0 0) 0x7fd058140550 con 0x7fd058138d40 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6789/0 conn(0x7fd0580a72f0 legacy=0x7fd05813f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.73:6789/0 conn(0x7fd05813f350 legacy=0x7fd0581d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 monclient: found mon.c 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0581428d0 con 0x7fd058138d40 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd05e8dd640 5 monclient: authenticate success, global_id 5764 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd05e8dd640 10 monclient: _renew_subs 2024-09-11T02:02:45.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd05e8dd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0581418a0 con 0x7fd058138d40 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd05e8dd640 10 monclient: _renew_subs 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd05e8dd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0580a1620 con 0x7fd058138d40 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0400038c0 con 0x7fd058138d40 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd040003e70 con 0x7fd058138d40 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd0567fc640 4 set_mon_vals no callback set 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.797+0000 7fd054ff9640 10 monclient: dump: 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.822 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.823 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd05e8dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd03c0065c0 con 0x7fd03c002860 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fd040004010 con 0x7fd058138d40 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(214..214 src has 1..214) ==== 3506+0+0 (unknown 3094403591 0 0) 0x7fd04004e390 con 0x7fd058138d40 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538851175 0 0) 0x7fd03c0065c0 con 0x7fd03c002860 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 10 monclient(hunting): my global_id is 5990 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd058140550 con 0x7fd03c002860 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd05ce7a640 10 monclient: get_auth_request con 0x7fd038040290 auth_method 0 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 121075838 0 0) 0x7fd058140550 con 0x7fd03c002860 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd03c0065c0 con 0x7fd03c002860 2024-09-11T02:02:45.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd048001c30 con 0x7fd03c002860 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.798+0000 7fd054ff9640 10 monclient: dump: 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.826 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.799+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 566100529 0 0) 0x7fd03c0065c0 con 0x7fd03c002860 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.799+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd03c00a160 con 0x7fd03c002860 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.799+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd048004fb0 con 0x7fd03c002860 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.799+0000 7fd054ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.799+0000 7fd054ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.799+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd03c002860 legacy=0x7fd03c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.799+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd03c002860 legacy=0x7fd03c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.805+0000 7fd05e8dd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.805+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd03c009e50 con 0x7fd03c009110 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236974780 0 0) 0x7fd03c009e50 con 0x7fd03c009110 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient(hunting): my global_id is 5999 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd03c0065c0 con 0x7fd03c009110 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd057fff640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd03c009110 legacy=0x7fd03c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd057fff640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd03c009110 legacy=0x7fd03c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd057fff640 1 --1- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd03c009110 0x7fd03c0095a0 :-1 s=OPENED pgs=314 cs=1 l=1).handle_message read tag failed 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd057fff640 1 --1- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd03c009110 0x7fd03c0095a0 :-1 s=OPENED pgs=314 cs=1 l=1).fault on lossy channel, failing 2024-09-11T02:02:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd03c009110 legacy=0x7fd03c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd03c009110 legacy=0x7fd03c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd03c009e50 con 0x7fd0380481e0 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875555601 0 0) 0x7fd03c009e50 con 0x7fd0380481e0 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient(hunting): my global_id is 6008 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd058140550 con 0x7fd0380481e0 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 18982732 0 0) 0x7fd058140550 con 0x7fd0380481e0 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd03c009e50 con 0x7fd0380481e0 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd048005750 con 0x7fd0380481e0 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 10 monclient: dump: 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1924653716 0 0) 0x7fd03c009e50 con 0x7fd0380481e0 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.806+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 --> v1:172.21.15.203:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd048004fb0 con 0x7fd0380481e0 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3705589624) 0x7fd048006c20 con 0x7fd0380481e0 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd054ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd054ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd0380481e0 legacy=0x7fd0380467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd054ff9640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6791/0 conn(0x7fd0380481e0 legacy=0x7fd0380467e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd05ce7a640 1 -- 172.21.15.73:0/1008636125 reap_dead start 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 288244, 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:45.834 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.835 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:45.836 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.837 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:45.838 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:45.839 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.840 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.841 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.842 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:45.843 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:45.844 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.846 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.847 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.849 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:45.850 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:45.851 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:45.852 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:45.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:45.854 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:45.854 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:45.854 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:02:45.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:45.854 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:45.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:45.854 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:45.854 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:45.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.203:6812/2311533528 conn(0x7fd038040290 legacy=0x7fd038042750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd05e8dd640 10 monclient: shutdown 2024-09-11T02:02:45.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd05e8dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 >> v1:172.21.15.73:6791/0 conn(0x7fd058138d40 legacy=0x7fd05813fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 shutdown_connections 2024-09-11T02:02:45.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 >> 172.21.15.73:0/1008636125 conn(0x7fd0580a8050 msgr2=0x7fd058131b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 shutdown_connections 2024-09-11T02:02:45.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.807+0000 7fd05e8dd640 1 -- 172.21.15.73:0/1008636125 wait complete. 2024-09-11T02:02:45.856 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:45.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-11T02:02:45.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-11T02:02:45.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.957+0000 7f2af6f5d640 10 monclient: get_monmap_and_config 2024-09-11T02:02:45.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.957+0000 7f2af6f5d640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.957+0000 7f2af6f5d640 10 monclient: monmap: 2024-09-11T02:02:45.959 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.959 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.959 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:45.958818+0000 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:45.958818+0000 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.960 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.958+0000 7f2af6f5d640 1 Processor -- start 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.958+0000 7f2af6f5d640 1 -- start start 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.958+0000 7f2af6f5d640 10 monclient: init 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 10 monclient: _add_conns ranks=[1,8,6,0,7,3,2,4,5] 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 10 monclient(hunting): picked mon.noname-f con 0x7f2af00a5b30 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 10 monclient(hunting): picked mon.noname-e con 0x7f2af00a6620 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 10 monclient(hunting): picked mon.noname-d con 0x7f2af009db70 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af00a7490 con 0x7f2af00a5b30 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af009ca00 con 0x7f2af009db70 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af006fbf0 con 0x7f2af00a6620 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 10 monclient(hunting): authenticate will time out at 1007.563215s 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aeffff640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f2af00a6620 0x7f2af013dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35382/0 (socket says 172.21.15.73:35382) 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aeffff640 1 -- 172.21.15.73:0/3196641181 learned_addr learned my addr 172.21.15.73:0/3196641181 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394645611 0 0) 0x7f2af009ca00 con 0x7f2af009db70 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): my global_id is 114927 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad8003520 con 0x7f2af009db70 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293674261 0 0) 0x7f2af006fbf0 con 0x7f2af00a6620 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): my global_id is 114956 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af009ca00 con 0x7f2af00a6620 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799530584 0 0) 0x7f2af00a7490 con 0x7f2af00a5b30 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient(hunting): my global_id is 5635 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af006fbf0 con 0x7f2af00a5b30 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 595312203 0 0) 0x7f2ad8003520 con 0x7f2af009db70 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 >> v1:172.21.15.73:6793/0 conn(0x7f2af00a6620 legacy=0x7f2af013dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 >> v1:172.21.15.203:6789/0 conn(0x7f2af00a5b30 legacy=0x7f2af00a5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 monclient: found mon.noname-d 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:02:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af009ceb0 con 0x7f2af009db70 2024-09-11T02:02:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2ae0001830 con 0x7f2af009db70 2024-09-11T02:02:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 5 monclient: authenticate success, global_id 114927 2024-09-11T02:02:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: dump: 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.973 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ae00019d0 con 0x7f2af009db70 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 1 -- 172.21.15.73:0/3196641181 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2ae0003950 con 0x7f2af009db70 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2af6f5d640 4 set_mon_vals no callback set 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.959+0000 7f2aef7fe640 10 monclient: dump: 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.975 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.960+0000 7f2af6f5d640 10 monclient: shutdown 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.960+0000 7f2af6f5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.960+0000 7f2af6f5d640 1 -- 172.21.15.73:0/3196641181 >> v1:172.21.15.73:6792/0 conn(0x7f2af009db70 legacy=0x7f2af0141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.960+0000 7f2af6f5d640 1 -- 172.21.15.73:0/3196641181 shutdown_connections 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.960+0000 7f2af6f5d640 1 -- 172.21.15.73:0/3196641181 >> 172.21.15.73:0/3196641181 conn(0x7f2af00abe30 msgr2=0x7f2af00a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.960+0000 7f2af6f5d640 1 -- 172.21.15.73:0/3196641181 shutdown_connections 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.960+0000 7f2af6f5d640 1 -- 172.21.15.73:0/3196641181 wait complete. 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.960+0000 7f2af6f5d640 10 monclient: build_initial_monmap 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.960+0000 7f2af6f5d640 10 monclient: monmap: 2024-09-11T02:02:45.976 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:45.977 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 1 Processor -- start 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 1 -- start start 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 10 monclient: init 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 10 monclient: _add_conns ranks=[2,4,6,7,8,0,1,3,5] 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 10 monclient(hunting): picked mon.noname-b con 0x7f2af00a5b30 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 10 monclient(hunting): picked mon.noname-c con 0x7f2af00a6620 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 10 monclient(hunting): picked mon.noname-d con 0x7f2af01d3ac0 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af0128fc0 con 0x7f2af00a5b30 2024-09-11T02:02:45.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af0125fc0 con 0x7f2af00a6620 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af006e920 con 0x7f2af01d3ac0 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.961+0000 7f2af6f5d640 10 monclient(hunting): authenticate will time out at 1007.565961s 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aeffff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f2af00a6620 0x7f2af01258b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50684/0 (socket says 172.21.15.73:50684) 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2af54fa640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f2af01d3ac0 0x7f2af01d5eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39928/0 (socket says 172.21.15.73:39928) 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2af4cf9640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f2af00a5b30 0x7f2af01251a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38620/0 (socket says 172.21.15.73:38620) 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aeffff640 1 -- 172.21.15.73:0/4199110731 learned_addr learned my addr 172.21.15.73:0/4199110731 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940441207 0 0) 0x7f2af006e920 con 0x7f2af01d3ac0 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): my global_id is 114936 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2adc003520 con 0x7f2af01d3ac0 2024-09-11T02:02:45.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984412880 0 0) 0x7f2af0125fc0 con 0x7f2af00a6620 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): my global_id is 5773 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af006e920 con 0x7f2af00a6620 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907129780 0 0) 0x7f2af0128fc0 con 0x7f2af00a5b30 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): my global_id is 134156 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af0125fc0 con 0x7f2af00a5b30 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 801692020 0 0) 0x7f2adc003520 con 0x7f2af01d3ac0 2024-09-11T02:02:45.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2af0128fc0 con 0x7f2af01d3ac0 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2ae0003930 con 0x7f2af01d3ac0 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): dump: 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.981 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3248991983 0 0) 0x7f2af0125fc0 con 0x7f2af00a5b30 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2adc003520 con 0x7f2af00a5b30 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1837378871 0 0) 0x7f2af006e920 con 0x7f2af00a6620 2024-09-11T02:02:45.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2af0125fc0 con 0x7f2af00a6620 2024-09-11T02:02:45.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2ae8001d50 con 0x7f2af00a5b30 2024-09-11T02:02:45.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): dump: 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.985 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2ae4001870 con 0x7f2af00a6620 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient(hunting): dump: 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.986 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2889244657 0 0) 0x7f2af0128fc0 con 0x7f2af01d3ac0 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 >> v1:172.21.15.73:6791/0 conn(0x7f2af00a6620 legacy=0x7f2af01258b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 >> v1:172.21.15.73:6790/0 conn(0x7f2af00a5b30 legacy=0x7f2af01251a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient: _finish_hunting 0 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 monclient: found mon.d 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af0128150 con 0x7f2af01d3ac0 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient: _finish_auth 0 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 10 monclient: _check_auth_tickets 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2aed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2af6f5d640 5 monclient: authenticate success, global_id 114936 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2af6f5d640 10 monclient: _renew_subs 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2af6f5d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2af0128ce0 con 0x7f2af01d3ac0 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2af6f5d640 10 monclient: _renew_subs 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2af6f5d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:45.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.962+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f2af0141990 con 0x7f2af01d3ac0 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ae0001210 con 0x7f2af01d3ac0 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2aed7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2ae0003c10 con 0x7f2af01d3ac0 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2aed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2aeeffd640 4 set_mon_vals no callback set 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2aed7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2aed7fa640 10 monclient: dump: 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.989 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2af6f5d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ad00065c0 con 0x7f2ad0002860 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.963+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f2ae0003e30 con 0x7f2af01d3ac0 2024-09-11T02:02:45.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(214..214 src has 1..214) ==== 3506+0+0 (unknown 3094403591 0 0) 0x7f2ae004e2a0 con 0x7f2af01d3ac0 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1033963894 0 0) 0x7f2ad00065c0 con 0x7f2ad0002860 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 10 monclient(hunting): my global_id is 5794 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2af0128fc0 con 0x7f2ad0002860 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aeffff640 10 monclient: get_auth_request con 0x7f2adc040630 auth_method 0 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1474309630 0 0) 0x7f2af0128fc0 con 0x7f2ad0002860 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ad00065c0 con 0x7f2ad0002860 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2ae8003cd0 con 0x7f2ad0002860 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:02:45.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 10 monclient: dump: 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.992 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.993 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 806543402 0 0) 0x7f2ad00065c0 con 0x7f2ad0002860 2024-09-11T02:02:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.203:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ad000a160 con 0x7f2ad0002860 2024-09-11T02:02:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2ae8005b40 con 0x7f2ad0002860 2024-09-11T02:02:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 >> v1:172.21.15.203:6792/0 conn(0x7f2ad0002860 legacy=0x7f2ad0004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.964+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 >> v1:172.21.15.203:6792/0 conn(0x7f2ad0002860 legacy=0x7f2ad0004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.970+0000 7f2af6f5d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.970+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ad0009e20 con 0x7f2ad00090e0 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687688759 0 0) 0x7f2ad0009e20 con 0x7f2ad00090e0 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 10 monclient(hunting): my global_id is 5803 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad00065c0 con 0x7f2ad00090e0 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 675523212 0 0) 0x7f2ad00065c0 con 0x7f2ad00090e0 2024-09-11T02:02:45.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ad0009e20 con 0x7f2ad00090e0 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2ae8004610 con 0x7f2ad00090e0 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 10 monclient: dump: 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:45.996 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1544966860 0 0) 0x7f2ad0009e20 con 0x7f2ad00090e0 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.971+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 --> v1:172.21.15.203:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2ad000c3f0 con 0x7f2ad00090e0 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 862244287) 0x7f2ae8007d80 con 0x7f2ad00090e0 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2aed7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2aed7fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:45.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 >> v1:172.21.15.203:6792/0 conn(0x7f2ad00090e0 legacy=0x7f2ad0009570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2aed7fa640 1 -- 172.21.15.73:0/4199110731 >> v1:172.21.15.203:6792/0 conn(0x7f2ad00090e0 legacy=0x7f2ad0009570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 288392, 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:45.998 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:45.999 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:02:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:46.018 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:46.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 >> v1:172.21.15.203:6812/2311533528 conn(0x7f2adc040630 legacy=0x7f2adc042af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:46.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af6f5d640 10 monclient: shutdown 2024-09-11T02:02:46.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af6f5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:46.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 >> v1:172.21.15.73:6792/0 conn(0x7f2af01d3ac0 legacy=0x7f2af01d5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af54fa640 1 -- 172.21.15.73:0/4199110731 reap_dead start 2024-09-11T02:02:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af54fa640 1 -- 172.21.15.73:0/4199110731 reap_dead start 2024-09-11T02:02:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 shutdown_connections 2024-09-11T02:02:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 >> 172.21.15.73:0/4199110731 conn(0x7f2af009db70 msgr2=0x7f2af0142400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 shutdown_connections 2024-09-11T02:02:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:45.972+0000 7f2af6f5d640 1 -- 172.21.15.73:0/4199110731 wait complete. 2024-09-11T02:02:46.020 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:46.020 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T02:02:46.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T02:02:46.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.118+0000 7f96ad847640 10 monclient: get_monmap_and_config 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.118+0000 7f96ad847640 10 monclient: build_initial_monmap 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.118+0000 7f96ad847640 10 monclient: monmap: 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:46.119106+0000 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:46.119106+0000 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:46.121 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:46.121 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:46.121 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:46.121 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:46.121 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:46.121 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:46.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.118+0000 7f96ad847640 1 Processor -- start 2024-09-11T02:02:46.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.118+0000 7f96ad847640 1 -- start start 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.118+0000 7f96ad847640 10 monclient: init 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 10 monclient: _add_conns ranks=[4,0,7,8,5,2,1,6,3] 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 10 monclient(hunting): picked mon.noname-c con 0x7f96a8138960 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 10 monclient(hunting): picked mon.noname-a con 0x7f96a8139450 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 10 monclient(hunting): picked mon.noname-i con 0x7f96a813f620 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a809d030 con 0x7f96a8139450 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a809d310 con 0x7f96a8138960 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a806f770 con 0x7f96a813f620 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96ad847640 10 monclient(hunting): authenticate will time out at 1007.723500s 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a67fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f96a8139450 0x7f96a813df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47192/0 (socket says 172.21.15.73:47192) 2024-09-11T02:02:46.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a6ffd640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f96a8138960 0x7f96a8138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50696/0 (socket says 172.21.15.73:50696) 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a67fc640 1 -- 172.21.15.73:0/123225328 learned_addr learned my addr 172.21.15.73:0/123225328 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193681031 0 0) 0x7f96a809d310 con 0x7f96a8138960 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 10 monclient(hunting): my global_id is 5782 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9694003520 con 0x7f96a8138960 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550775973 0 0) 0x7f96a809d030 con 0x7f96a8139450 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 10 monclient(hunting): my global_id is 5976 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.119+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96a809d310 con 0x7f96a8139450 2024-09-11T02:02:46.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2930867849 0 0) 0x7f96a809d310 con 0x7f96a8139450 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 >> v1:172.21.15.203:6792/0 conn(0x7f96a813f620 legacy=0x7f96a8141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 >> v1:172.21.15.73:6791/0 conn(0x7f96a8138960 legacy=0x7f96a8138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 1 monclient: found mon.noname-a 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a80a7360 con 0x7f96a8139450 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: _finish_auth 0 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 5 monclient: authenticate success, global_id 5976 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:46.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9690001810 con 0x7f96a8139450 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: dump: 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:46.132 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9690001a30 con 0x7f96a8139450 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 1 -- 172.21.15.73:0/123225328 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9690004be0 con 0x7f96a8139450 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 4 set_mon_vals no callback set 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96a5ffb640 10 monclient: dump: 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 10 monclient: shutdown 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 1 -- 172.21.15.73:0/123225328 >> v1:172.21.15.73:6789/0 conn(0x7f96a8139450 legacy=0x7f96a813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 1 -- 172.21.15.73:0/123225328 shutdown_connections 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 1 -- 172.21.15.73:0/123225328 >> 172.21.15.73:0/123225328 conn(0x7f96a80a8050 msgr2=0x7f96a80a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 1 -- 172.21.15.73:0/123225328 shutdown_connections 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.120+0000 7f96ad847640 1 -- 172.21.15.73:0/123225328 wait complete. 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.121+0000 7f96ad847640 10 monclient: build_initial_monmap 2024-09-11T02:02:46.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.121+0000 7f96ad847640 10 monclient: monmap: 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:46.136 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.121+0000 7f96ad847640 1 Processor -- start 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.121+0000 7f96ad847640 1 -- start start 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.121+0000 7f96ad847640 10 monclient: init 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 10 monclient: _add_conns ranks=[2,5,6,1,7,4,3,8,0] 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 10 monclient(hunting): picked mon.noname-b con 0x7f96a8138960 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 10 monclient(hunting): picked mon.noname-h con 0x7f96a8139450 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 10 monclient(hunting): picked mon.noname-d con 0x7f96a813f620 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a813aa90 con 0x7f96a8138960 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a8142b50 con 0x7f96a8139450 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a813f1c0 con 0x7f96a813f620 2024-09-11T02:02:46.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96ad847640 10 monclient(hunting): authenticate will time out at 1007.726469s 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96a6ffd640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f96a8138960 0x7f96a8139c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38632/0 (socket says 172.21.15.73:38632) 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96a6ffd640 1 -- 172.21.15.73:0/2335504731 learned_addr learned my addr 172.21.15.73:0/2335504731 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f96a77fe640 1 --1- 172.21.15.73:0/2335504731 >> v1:172.21.15.73:6792/0 conn(0x7f96a813f620 0x7f96a81d5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39932/0 (socket says 172.21.15.73:39932) 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2092496335 0 0) 0x7f96a813aa90 con 0x7f96a8138960 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): my global_id is 134165 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9688003520 con 0x7f96a8138960 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585240683 0 0) 0x7f96a813f1c0 con 0x7f96a813f620 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:46.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): my global_id is 114945 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96a813aa90 con 0x7f96a813f620 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899138809 0 0) 0x7f96a8142b50 con 0x7f96a8139450 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): my global_id is 6017 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96a813f1c0 con 0x7f96a8139450 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1171439093 0 0) 0x7f9688003520 con 0x7f96a8138960 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96a8142b50 con 0x7f96a8138960 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9698001800 con 0x7f96a8138960 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:46.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.122+0000 7f969ffff640 10 monclient(hunting): dump: 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:46.140 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1783771514 0 0) 0x7f96a813aa90 con 0x7f96a813f620 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9688003520 con 0x7f96a813f620 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f96a00018d0 con 0x7f96a813f620 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient(hunting): dump: 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:46.141 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:46.142 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 661169454 0 0) 0x7f96a8142b50 con 0x7f96a8138960 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 >> v1:172.21.15.73:6792/0 conn(0x7f96a813f620 legacy=0x7f96a81d5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 >> v1:172.21.15.203:6791/0 conn(0x7f96a8139450 legacy=0x7f96a813a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient: _finish_hunting 0 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 monclient: found mon.b 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a813c850 con 0x7f96a8138960 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient: _finish_auth 0 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient: _check_auth_tickets 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f96ad847640 5 monclient: authenticate success, global_id 134165 2024-09-11T02:02:46.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f96ad847640 10 monclient: _renew_subs 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f96ad847640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f96a813bfb0 con 0x7f96a8138960 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f96ad847640 10 monclient: _renew_subs 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f96ad847640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f96a8141a50 con 0x7f96a8138960 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9698004e10 con 0x7f96a8138960 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9698001b20 con 0x7f96a8138960 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f96a57fa640 4 set_mon_vals no callback set 2024-09-11T02:02:46.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 10 monclient: dump: 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:46.145 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:46.146 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:46.146 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:46.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.123+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f96980118a0 con 0x7f96a8138960 2024-09-11T02:02:46.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.124+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(214..214 src has 1..214) ==== 3506+0+0 (unknown 3094403591 0 0) 0x7f969804e610 con 0x7f96a8138960 2024-09-11T02:02:46.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.124+0000 7f96ad847640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:46.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.124+0000 7f96ad847640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:46.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.124+0000 7f96ad847640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:46.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.124+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c005080 con 0x7f96a8138960 2024-09-11T02:02:46.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.124+0000 7f96a67fc640 10 monclient: get_auth_request con 0x7f9688040310 auth_method 0 2024-09-11T02:02:46.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.128+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f9698017a30 con 0x7f96a8138960 2024-09-11T02:02:46.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.128+0000 7f969ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:46.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.128+0000 7f969ffff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:46.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.373+0000 7f96ad847640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-11T02:02:46.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.373+0000 7f96ad847640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-11T02:02:46.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.373+0000 7f96ad847640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:46.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.373+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f968c005b80 con 0x7f96a8138960 2024-09-11T02:02:46.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.375+0000 7f969ffff640 1 -- 172.21.15.73:0/2335504731 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f9698017330 con 0x7f96a8138960 2024-09-11T02:02:46.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.375+0000 7f969ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-11T02:02:46.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.375+0000 7f969ffff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.377+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9688040310 legacy=0x7f96880427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.377+0000 7f96ad847640 10 monclient: shutdown 2024-09-11T02:02:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.377+0000 7f96ad847640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.377+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 >> v1:172.21.15.73:6790/0 conn(0x7f96a8138960 legacy=0x7f96a8139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.377+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 shutdown_connections 2024-09-11T02:02:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.377+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 >> 172.21.15.73:0/2335504731 conn(0x7f96a80a8050 msgr2=0x7f96a80a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:46.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.377+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 shutdown_connections 2024-09-11T02:02:46.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:46.377+0000 7f96ad847640 1 -- 172.21.15.73:0/2335504731 wait complete. 2024-09-11T02:02:46.398 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-11T02:02:46.419 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.419 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=12,logm=55} crc {auth=1935126575,config=1747058506,health=2502056798,kv=691542103,logm=487851168}) 2024-09-11T02:02:46.419 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=1,health=12,kv=12,logm=56} crc {auth=4112992828,config=1228700967,health=2502056798,kv=691542103,logm=3842965810}) 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=12,logm=55} crc {auth=1935126575,config=1747058506,health=2502056798,kv=691542103,logm=487851168}) 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=20,config=1,health=10,kv=12,logm=57} crc {auth=1935126575,config=1228700967,health=3179301315,kv=691542103,logm=2205508813}) 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=12,logm=55} crc {auth=1935126575,config=1747058506,health=2502056798,kv=691542103,logm=487851168}) 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=20,config=2,health=11,kv=12,logm=55} crc {auth=1935126575,config=2586702516,health=1534400794,kv=691542103,logm=1991197285}) 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=12,logm=55} crc {auth=1935126575,config=1747058506,health=2502056798,kv=691542103,logm=487851168}) 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=20,config=2,health=11,kv=11,logm=56} crc {auth=2094655473,config=2586702516,health=2247016691,kv=1619563768,logm=1957045667}) 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.420 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=12,logm=55} crc {auth=1935126575,config=1747058506,health=2502056798,kv=691542103,logm=487851168}) 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=2,health=11,kv=12,logm=57} crc {auth=1118622755,config=2586702516,health=3822630261,kv=691542103,logm=1576973120}) 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=12,logm=55} crc {auth=1935126575,config=1747058506,health=2502056798,kv=691542103,logm=487851168}) 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=20,config=2,health=12,kv=12,logm=54} crc {auth=1935126575,config=2586702516,health=2502056798,kv=691542103,logm=1314009523}) 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=12,logm=55} crc {auth=1935126575,config=1747058506,health=2502056798,kv=691542103,logm=487851168}) 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=19,config=2,health=11,kv=11,logm=57} crc {auth=3198484956,config=2586702516,health=416787642,kv=1883492191,logm=4196905902}) 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=12,logm=55} crc {auth=1935126575,config=1747058506,health=2502056798,kv=691542103,logm=487851168}) 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.375+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=20,config=2,health=12,kv=12,logm=54} crc {auth=1935126575,config=2586702516,health=2502056798,kv=691542103,logm=1438070177}) 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.421 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512834012}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=669912872}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512834012}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1738945428}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512834012}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2786018206}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512834012}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1029126216}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512834012}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4038111176}) 2024-09-11T02:02:46.422 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512834012}) 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2287713245}) 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512834012}) 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=320135719}) 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2512834012}) 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.377+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3844911399}) 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484587033}) 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1768558515}) 2024-09-11T02:02:46.423 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484587033}) 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2713492633}) 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484587033}) 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3710980266}) 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484587033}) 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3762466146}) 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484587033}) 2024-09-11T02:02:46.424 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3377770128}) 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484587033}) 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1271864175}) 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484587033}) 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2090955942}) 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2484587033}) 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.379+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2614721870}) 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899628913}) 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799366432}) 2024-09-11T02:02:46.425 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899628913}) 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1209834272}) 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899628913}) 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3236725996}) 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899628913}) 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3371629060}) 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899628913}) 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1326443804}) 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.426 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899628913}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.380+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3666690235}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.381+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.381+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899628913}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.381+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4184374647}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.381+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.381+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899628913}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.381+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3550629452}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1397736136}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848662890}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1397736136}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4150170992}) 2024-09-11T02:02:46.427 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1397736136}) 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3472774182}) 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1397736136}) 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3268613321}) 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1397736136}) 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=869418682}) 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1397736136}) 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=164557346}) 2024-09-11T02:02:46.428 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1397736136}) 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3239018942}) 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1397736136}) 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.382+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2471857999}) 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3093449097}) 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=248675787}) 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3093449097}) 2024-09-11T02:02:46.429 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1520241475}) 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3093449097}) 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=872138541}) 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.383+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3093449097}) 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1510678118}) 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3093449097}) 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1009100111}) 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3093449097}) 2024-09-11T02:02:46.430 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1035750549}) 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3093449097}) 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3595220966}) 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3093449097}) 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.384+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3917585786}) 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880679764}) 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2234347587}) 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880679764}) 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1088104850}) 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.431 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880679764}) 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2026952823}) 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880679764}) 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3769863584}) 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880679764}) 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=385859774}) 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880679764}) 2024-09-11T02:02:46.432 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3082270263}) 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880679764}) 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1131674720}) 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880679764}) 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.385+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2882397094}) 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741913846}) 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=228834803}) 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741913846}) 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3508228893}) 2024-09-11T02:02:46.433 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.434 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741913846}) 2024-09-11T02:02:46.434 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2284963746}) 2024-09-11T02:02:46.434 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.434 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741913846}) 2024-09-11T02:02:46.434 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1102586579}) 2024-09-11T02:02:46.434 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.434 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741913846}) 2024-09-11T02:02:46.434 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.386+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3774767051}) 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.387+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.387+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741913846}) 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.387+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2816575516}) 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.387+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.387+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741913846}) 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.387+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2177399919}) 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.387+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.387+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741913846}) 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.387+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=409048029}) 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088321910}) 2024-09-11T02:02:46.435 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2569463594}) 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088321910}) 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2299043882}) 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088321910}) 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3499014890}) 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088321910}) 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=554278146}) 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.436 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088321910}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2987127702}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088321910}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3909529493}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088321910}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3584966549}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3088321910}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.388+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4126092673}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3684614844}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544037286}) 2024-09-11T02:02:46.437 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3684614844}) 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4125863732}) 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3684614844}) 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2629443749}) 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3684614844}) 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1788311409}) 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3684614844}) 2024-09-11T02:02:46.438 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2256858635}) 2024-09-11T02:02:46.439 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.439 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3684614844}) 2024-09-11T02:02:46.439 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3097615604}) 2024-09-11T02:02:46.439 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.439 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3684614844}) 2024-09-11T02:02:46.439 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745861178}) 2024-09-11T02:02:46.439 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.439 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3684614844}) 2024-09-11T02:02:46.439 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.389+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1316282733}) 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2612473739}) 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128747454}) 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2612473739}) 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3294367903}) 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2612473739}) 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1859891781}) 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2612473739}) 2024-09-11T02:02:46.440 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1893648039}) 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2612473739}) 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=543504500}) 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2612473739}) 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2305130241}) 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2612473739}) 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1168815422}) 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2612473739}) 2024-09-11T02:02:46.441 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.391+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4021447557}) 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=242836143}) 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2253756015}) 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=242836143}) 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2517535612}) 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=242836143}) 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2008174756}) 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=242836143}) 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4211113056}) 2024-09-11T02:02:46.442 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=242836143}) 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2202115326}) 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=242836143}) 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1630138687}) 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=242836143}) 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=132902419}) 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=242836143}) 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.392+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1023644426}) 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.393+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.393+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=954302769}) 2024-09-11T02:02:46.443 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.393+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3618494020}) 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.393+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.393+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=954302769}) 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.393+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3045100804}) 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=954302769}) 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1379861505}) 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=954302769}) 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3000894544}) 2024-09-11T02:02:46.444 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=954302769}) 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3325355572}) 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=954302769}) 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=249079079}) 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=954302769}) 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2904975202}) 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=954302769}) 2024-09-11T02:02:46.445 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.394+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2457922591}) 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3847809100}) 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3282881621}) 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3847809100}) 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4077251815}) 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3847809100}) 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=666766102}) 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3847809100}) 2024-09-11T02:02:46.446 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1184881638}) 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3847809100}) 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1813066364}) 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3847809100}) 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3071672290}) 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3847809100}) 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3286867797}) 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3847809100}) 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.395+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3625115383}) 2024-09-11T02:02:46.447 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1107869281,mdsmap=3149052893,mgr=407212650,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=920682300,osd_pg_creating=2174997779,osd_snap=4133920409,osdmap=2109610321}) 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=36} crc {logm=1265727592,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=780753344,mon_config_key=4062224887,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001358,osd_pg_creating=2174997778,osd_snap=4133920409,osdmap=2611349278}) 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1107869281,mdsmap=3149052893,mgr=407212650,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=920682300,osd_pg_creating=2174997779,osd_snap=4133920409,osdmap=2109610321}) 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=11,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=36} crc {logm=1107869281,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2174997778,osd_snap=1914091868,osdmap=3876545461}) 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1107869281,mdsmap=3149052893,mgr=407212650,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=920682300,osd_pg_creating=2174997779,osd_snap=4133920409,osdmap=2109610321}) 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=11,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=36} crc {logm=1107869281,mdsmap=3149052893,mgr=4117201350,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=386759338,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2174997778,osd_snap=4133920409,osdmap=69204005}) 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1107869281,mdsmap=3149052893,mgr=407212650,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=920682300,osd_pg_creating=2174997779,osd_snap=4133920409,osdmap=2109610321}) 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=39} crc {logm=2823343443,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=1779361073,mon_config_key=1388796035,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2174997778,osd_snap=4133920409,osdmap=2215563759}) 2024-09-11T02:02:46.448 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1107869281,mdsmap=3149052893,mgr=407212650,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=920682300,osd_pg_creating=2174997779,osd_snap=4133920409,osdmap=2109610321}) 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=10,mdsmap=3,mgr=7,mgr_command_descs=1,mgrstat=10,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1378444880,mdsmap=3149052893,mgr=2248164467,mgr_command_descs=3192186153,mgrstat=3749752910,mon_config_key=386759338,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2174997778,osd_snap=4133920409,osdmap=4081469271}) 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1107869281,mdsmap=3149052893,mgr=407212650,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=920682300,osd_pg_creating=2174997779,osd_snap=4133920409,osdmap=2109610321}) 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=38} crc {logm=753439087,mdsmap=1626750132,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=223997358,mon_config_key=2865513720,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2174997778,osd_snap=4133920409,osdmap=2423934216}) 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1107869281,mdsmap=3149052893,mgr=407212650,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=920682300,osd_pg_creating=2174997779,osd_snap=4133920409,osdmap=2109610321}) 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=15,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=39} crc {logm=409870907,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=1089942145,mon_config_key=1034470109,monmap=2295470326,nvmeofgw=1596038039,osd_metadata=1227001357,osd_pg_creating=2174997778,osd_snap=4133920409,osdmap=1097555359}) 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.449 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.397+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=37} crc {logm=1107869281,mdsmap=3149052893,mgr=407212650,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=3749752910,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=920682300,osd_pg_creating=2174997779,osd_snap=4133920409,osdmap=2109610321}) 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.398+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=10,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=39} crc {logm=3067970357,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=751879980,mon_config_key=3190261039,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2174997778,osd_snap=4133920409,osdmap=2879553161}) 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1791666804}) 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3472395296}) 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1791666804}) 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=682283100}) 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1791666804}) 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=4186638434}) 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1791666804}) 2024-09-11T02:02:46.450 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=4149719130}) 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1791666804}) 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3367211900}) 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1791666804}) 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=791588104}) 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1791666804}) 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1632574077}) 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1791666804}) 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.399+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=383557538}) 2024-09-11T02:02:46.451 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.452 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=333572344}) 2024-09-11T02:02:46.452 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3375723420}) 2024-09-11T02:02:46.452 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.452 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=333572344}) 2024-09-11T02:02:46.452 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3970563836}) 2024-09-11T02:02:46.452 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.452 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=333572344}) 2024-09-11T02:02:46.452 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=1210704552}) 2024-09-11T02:02:46.452 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.400+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=333572344}) 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=507841051}) 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=333572344}) 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3021297743}) 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=333572344}) 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3179978967}) 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=333572344}) 2024-09-11T02:02:46.453 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2661113536}) 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=333572344}) 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.401+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=4235053145}) 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.402+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.402+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=92} crc {osdmap=589364864}) 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.402+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=89} crc {osdmap=2168153207}) 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.402+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.402+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=92} crc {osdmap=589364864}) 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=91} crc {osdmap=4247654617}) 2024-09-11T02:02:46.454 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.455 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=92} crc {osdmap=589364864}) 2024-09-11T02:02:46.455 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=92} crc {osdmap=725727899}) 2024-09-11T02:02:46.455 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.455 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=92} crc {osdmap=589364864}) 2024-09-11T02:02:46.455 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=84} crc {osdmap=1032317325}) 2024-09-11T02:02:46.455 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.455 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=92} crc {osdmap=589364864}) 2024-09-11T02:02:46.455 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=91} crc {osdmap=1402708687}) 2024-09-11T02:02:46.455 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.456 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=92} crc {osdmap=589364864}) 2024-09-11T02:02:46.456 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=90} crc {osdmap=1675167122}) 2024-09-11T02:02:46.456 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.456 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=92} crc {osdmap=589364864}) 2024-09-11T02:02:46.456 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=91} crc {osdmap=124646551}) 2024-09-11T02:02:46.456 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:02:46.456 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=92} crc {osdmap=589364864}) 2024-09-11T02:02:46.457 INFO:tasks.ceph.mon.f.smithi203.stderr:2024-09-11T02:02:46.403+0000 7f199a6ef640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=93} crc {osdmap=2424590053}) 2024-09-11T02:02:47.400 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-11T02:02:47.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:02:47.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.508+0000 7f92e5c8c640 10 monclient: get_monmap_and_config 2024-09-11T02:02:47.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.508+0000 7f92e5c8c640 10 monclient: build_initial_monmap 2024-09-11T02:02:47.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.508+0000 7f92e5c8c640 10 monclient: monmap: 2024-09-11T02:02:47.509 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:47.508965+0000 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:47.508965+0000 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:47.510 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:47.511 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:47.511 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 1 Processor -- start 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 1 -- start start 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 10 monclient: init 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 10 monclient: _add_conns ranks=[6,7,1,3,8,4,5,0,2] 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 10 monclient(hunting): picked mon.noname-d con 0x7f92e0138960 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 10 monclient(hunting): picked mon.noname-i con 0x7f92e0139450 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 10 monclient(hunting): picked mon.noname-f con 0x7f92e013f620 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e009d030 con 0x7f92e013f620 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e009d310 con 0x7f92e0138960 2024-09-11T02:02:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e006f770 con 0x7f92e0139450 2024-09-11T02:02:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92e5c8c640 10 monclient(hunting): authenticate will time out at 1009.113793s 2024-09-11T02:02:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92df7fe640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f92e0138960 0x7f92e0138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39948/0 (socket says 172.21.15.73:39948) 2024-09-11T02:02:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.509+0000 7f92df7fe640 1 -- 172.21.15.73:0/4079018109 learned_addr learned my addr 172.21.15.73:0/4079018109 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 -- 172.21.15.73:0/4079018109 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455896817 0 0) 0x7f92e009d310 con 0x7f92e0138960 2024-09-11T02:02:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient(hunting): my global_id is 114954 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 -- 172.21.15.73:0/4079018109 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92cc003520 con 0x7f92e0138960 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 -- 172.21.15.73:0/4079018109 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3625787405 0 0) 0x7f92cc003520 con 0x7f92e0138960 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 -- 172.21.15.73:0/4079018109 >> v1:172.21.15.203:6792/0 conn(0x7f92e0139450 legacy=0x7f92e013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 -- 172.21.15.73:0/4079018109 >> v1:172.21.15.203:6789/0 conn(0x7f92e013f620 legacy=0x7f92e0141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: _finish_hunting 0 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 monclient: found mon.noname-d 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 -- 172.21.15.73:0/4079018109 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e00a7360 con 0x7f92e0138960 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: _finish_auth 0 2024-09-11T02:02:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: _check_auth_tickets 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 -- 172.21.15.73:0/4079018109 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f92d0001830 con 0x7f92e0138960 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92e5c8c640 5 monclient: authenticate success, global_id 114954 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92e5c8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: dump: 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.522 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92e5c8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 -- 172.21.15.73:0/4079018109 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f92d00019d0 con 0x7f92e0138960 2024-09-11T02:02:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 1 -- 172.21.15.73:0/4079018109 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f92d0004be0 con 0x7f92e0138960 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92e5c8c640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92e5c8c640 4 set_mon_vals no callback set 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.510+0000 7f92deffd640 10 monclient: dump: 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.511+0000 7f92e5c8c640 10 monclient: shutdown 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.511+0000 7f92e5c8c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.511+0000 7f92e5c8c640 1 -- 172.21.15.73:0/4079018109 >> v1:172.21.15.73:6792/0 conn(0x7f92e0138960 legacy=0x7f92e0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.511+0000 7f92e5c8c640 1 -- 172.21.15.73:0/4079018109 shutdown_connections 2024-09-11T02:02:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.511+0000 7f92e5c8c640 1 -- 172.21.15.73:0/4079018109 >> 172.21.15.73:0/4079018109 conn(0x7f92e00a8050 msgr2=0x7f92e00a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.511+0000 7f92e5c8c640 1 -- 172.21.15.73:0/4079018109 shutdown_connections 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.511+0000 7f92e5c8c640 1 -- 172.21.15.73:0/4079018109 wait complete. 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.511+0000 7f92e5c8c640 10 monclient: build_initial_monmap 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.511+0000 7f92e5c8c640 10 monclient: monmap: 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:47.526 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 1 Processor -- start 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 1 -- start start 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 10 monclient: init 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 10 monclient: _add_conns ranks=[6,0,1,5,7,4,2,3,8] 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 10 monclient(hunting): picked mon.noname-d con 0x7f92e0138960 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 10 monclient(hunting): picked mon.noname-a con 0x7f92e0139450 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 10 monclient(hunting): picked mon.noname-f con 0x7f92e013f620 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e0142ac0 con 0x7f92e0139450 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e013c760 con 0x7f92e013f620 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e013aab0 con 0x7f92e0138960 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92e5c8c640 10 monclient(hunting): authenticate will time out at 1009.116674s 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92df7fe640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f92e0138960 0x7f92e0139c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:39964/0 (socket says 172.21.15.73:39964) 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92df7fe640 1 -- 172.21.15.73:0/2058294736 learned_addr learned my addr 172.21.15.73:0/2058294736 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782170260 0 0) 0x7f92e013aab0 con 0x7f92e0138960 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 10 monclient(hunting): my global_id is 114963 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c0003520 con 0x7f92e0138960 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120159697 0 0) 0x7f92c8001270 con 0x7f92e0139450 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 10 monclient(hunting): my global_id is 5985 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.512+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92e013aab0 con 0x7f92e0139450 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991603761 0 0) 0x7f92e013c760 con 0x7f92e013f620 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): my global_id is 5653 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c8001270 con 0x7f92e013f620 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3185681681 0 0) 0x7f92c0003520 con 0x7f92e0138960 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92e013c760 con 0x7f92e0138960 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f92d00047e0 con 0x7f92e0138960 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): dump: 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.530 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1816013614 0 0) 0x7f92e013aab0 con 0x7f92e0139450 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92c0003520 con 0x7f92e0139450 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f92c8001c60 con 0x7f92e0139450 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient(hunting): dump: 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.532 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1642809474 0 0) 0x7f92e013c760 con 0x7f92e0138960 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 >> v1:172.21.15.203:6789/0 conn(0x7f92e013f620 legacy=0x7f92e01d57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 >> v1:172.21.15.73:6789/0 conn(0x7f92e0139450 legacy=0x7f92e013a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient: _finish_hunting 0 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 monclient: found mon.d 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e013ca40 con 0x7f92e0138960 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient: _finish_auth 0 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient: _check_auth_tickets 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92e5c8c640 5 monclient: authenticate success, global_id 114963 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92e5c8c640 10 monclient: _renew_subs 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92e5c8c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f92e013f150 con 0x7f92e0138960 2024-09-11T02:02:47.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92e5c8c640 10 monclient: _renew_subs 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92e5c8c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f92e013c480 con 0x7f92e0138960 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f92d00011f0 con 0x7f92e0138960 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f92d0001990 con 0x7f92e0138960 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92de7fc640 4 set_mon_vals no callback set 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.513+0000 7f92dcff9640 10 monclient: dump: 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.514+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f92d0011780 con 0x7f92e0138960 2024-09-11T02:02:47.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.514+0000 7f92e5c8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:47.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.514+0000 7f92e5c8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:47.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.514+0000 7f92e5c8c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:47.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.514+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c4005080 con 0x7f92e0138960 2024-09-11T02:02:47.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.514+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(215..215 src has 1..215) ==== 3898+0+0 (unknown 2178869517 0 0) 0x7f92d004e520 con 0x7f92e0138960 2024-09-11T02:02:47.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.514+0000 7f92d7fff640 10 monclient: get_auth_request con 0x7f92c00403a0 auth_method 0 2024-09-11T02:02:47.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.519+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f92d00177b0 con 0x7f92e0138960 2024-09-11T02:02:47.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.519+0000 7f92dcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:47.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.519+0000 7f92dcff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.778+0000 7f92e5c8c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:02:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.778+0000 7f92e5c8c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:02:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.778+0000 7f92e5c8c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.778+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f92c4005370 con 0x7f92e0138960 2024-09-11T02:02:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.778+0000 7f92dcff9640 1 -- 172.21.15.73:0/2058294736 <== mon.6 v1:172.21.15.73:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 3599658362) 0x7f92d00170b0 con 0x7f92e0138960 2024-09-11T02:02:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.778+0000 7f92dcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:02:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.778+0000 7f92dcff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:47.780 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":40,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:02:47.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.781+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 >> v1:172.21.15.203:6812/2311533528 conn(0x7f92c00403a0 legacy=0x7f92c0042860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.781+0000 7f92e5c8c640 10 monclient: shutdown 2024-09-11T02:02:47.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.781+0000 7f92e5c8c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:47.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.781+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 >> v1:172.21.15.73:6792/0 conn(0x7f92e0138960 legacy=0x7f92e0139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.781+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 shutdown_connections 2024-09-11T02:02:47.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.781+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 >> 172.21.15.73:0/2058294736 conn(0x7f92e00a8050 msgr2=0x7f92e00a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:47.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.781+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 shutdown_connections 2024-09-11T02:02:47.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.781+0000 7f92e5c8c640 1 -- 172.21.15.73:0/2058294736 wait complete. 2024-09-11T02:02:47.793 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-11T02:02:47.793 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T02:02:47.794 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-11T02:02:47.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T02:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38278]: starting. 2024-09-11T02:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38278]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38277 2024-09-11T02:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38278]: created object 0... 2024-09-11T02:02:47.813 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38278]: created object 25... 2024-09-11T02:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38278]: created object 49... 2024-09-11T02:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38278]: finishing. 2024-09-11T02:02:47.814 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38278]: shutting down. 2024-09-11T02:02:47.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.891+0000 7fb1f7556640 10 monclient: get_monmap_and_config 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.891+0000 7fb1f7556640 10 monclient: build_initial_monmap 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.891+0000 7fb1f7556640 10 monclient: monmap: 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:47.892160+0000 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:47.892160+0000 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:47.893 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:47.894 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:47.894 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:47.894 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:47.894 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:47.894 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.891+0000 7fb1f7556640 1 Processor -- start 2024-09-11T02:02:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 1 -- start start 2024-09-11T02:02:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 10 monclient: init 2024-09-11T02:02:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 10 monclient: _add_conns ranks=[1,7,0,2,4,8,6,3,5] 2024-09-11T02:02:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 10 monclient(hunting): picked mon.noname-f con 0x7fb1f0138960 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 10 monclient(hunting): picked mon.noname-i con 0x7fb1f0139450 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 10 monclient(hunting): picked mon.noname-a con 0x7fb1f013f620 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:47.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f009d030 con 0x7fb1f013f620 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f009d310 con 0x7fb1f0138960 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f006f770 con 0x7fb1f0139450 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f7556640 10 monclient(hunting): authenticate will time out at 1009.496710s 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f5af3640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb1f013f620 0x7fb1f0141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47218/0 (socket says 172.21.15.73:47218) 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.892+0000 7fb1f5af3640 1 -- 172.21.15.73:0/1762352522 learned_addr learned my addr 172.21.15.73:0/1762352522 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4280770194 0 0) 0x7fb1f009d030 con 0x7fb1f013f620 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): my global_id is 5994 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1d8003520 con 0x7fb1f013f620 2024-09-11T02:02:47.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156465249 0 0) 0x7fb1f009d310 con 0x7fb1f0138960 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): my global_id is 5662 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f009d030 con 0x7fb1f0138960 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812528780 0 0) 0x7fb1f006f770 con 0x7fb1f0139450 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient(hunting): my global_id is 5830 2024-09-11T02:02:47.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f009d310 con 0x7fb1f0139450 2024-09-11T02:02:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3558693949 0 0) 0x7fb1d8003520 con 0x7fb1f013f620 2024-09-11T02:02:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 >> v1:172.21.15.203:6792/0 conn(0x7fb1f0139450 legacy=0x7fb1f013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 >> v1:172.21.15.203:6789/0 conn(0x7fb1f0138960 legacy=0x7fb1f0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: _finish_hunting 0 2024-09-11T02:02:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 monclient: found mon.noname-a 2024-09-11T02:02:47.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f00a7360 con 0x7fb1f013f620 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: _finish_auth 0 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: _check_auth_tickets 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb1e8001830 con 0x7fb1f013f620 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 5 monclient: authenticate success, global_id 5994 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:47.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: dump: 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.907 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1e8001a50 con 0x7fb1f013f620 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 1 -- 172.21.15.73:0/1762352522 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb1e8004be0 con 0x7fb1f013f620 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 4 set_mon_vals no callback set 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:47.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1effff640 10 monclient: dump: 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.909 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.910 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 10 monclient: shutdown 2024-09-11T02:02:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:47.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 1 -- 172.21.15.73:0/1762352522 >> v1:172.21.15.73:6789/0 conn(0x7fb1f013f620 legacy=0x7fb1f0141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 1 -- 172.21.15.73:0/1762352522 shutdown_connections 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.893+0000 7fb1f7556640 1 -- 172.21.15.73:0/1762352522 >> 172.21.15.73:0/1762352522 conn(0x7fb1f00a8050 msgr2=0x7fb1f00a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.894+0000 7fb1f7556640 1 -- 172.21.15.73:0/1762352522 shutdown_connections 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.894+0000 7fb1f7556640 1 -- 172.21.15.73:0/1762352522 wait complete. 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.894+0000 7fb1f7556640 10 monclient: build_initial_monmap 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.894+0000 7fb1f7556640 10 monclient: monmap: 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:47.911 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.894+0000 7fb1f7556640 1 Processor -- start 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.894+0000 7fb1f7556640 1 -- start start 2024-09-11T02:02:47.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.894+0000 7fb1f7556640 10 monclient: init 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 10 monclient: _add_conns ranks=[5,4,6,8,2,3,1,0,7] 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 10 monclient(hunting): picked mon.noname-h con 0x7fb1f0138960 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 10 monclient(hunting): picked mon.noname-c con 0x7fb1f0139450 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 10 monclient(hunting): picked mon.noname-d con 0x7fb1f013f620 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f0138d40 con 0x7fb1f0139450 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f0142ac0 con 0x7fb1f0138960 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f00a1c10 con 0x7fb1f013f620 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f7556640 10 monclient(hunting): authenticate will time out at 1009.499423s 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f4af1640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fb1f0139450 0x7fb1f01d2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50700/0 (socket says 172.21.15.73:50700) 2024-09-11T02:02:47.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1f4af1640 1 -- 172.21.15.73:0/3020632221 learned_addr learned my addr 172.21.15.73:0/3020632221 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618161105 0 0) 0x7fb1f00a1c10 con 0x7fb1f013f620 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): my global_id is 114972 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1dc003520 con 0x7fb1f013f620 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382276845 0 0) 0x7fb1f0138d40 con 0x7fb1f0139450 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): my global_id is 5791 2024-09-11T02:02:47.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f00a1c10 con 0x7fb1f0139450 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1278275870 0 0) 0x7fb1f0142ac0 con 0x7fb1f0138960 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): my global_id is 6026 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f0138d40 con 0x7fb1f0138960 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 26038161 0 0) 0x7fb1f00a1c10 con 0x7fb1f0139450 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1f0142ac0 con 0x7fb1f0139450 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb1e4001dd0 con 0x7fb1f0139450 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): dump: 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.915 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.916 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.895+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2337816124 0 0) 0x7fb1dc003520 con 0x7fb1f013f620 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1f00a1c10 con 0x7fb1f013f620 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2253553050 0 0) 0x7fb1f0138d40 con 0x7fb1f0138960 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1dc003520 con 0x7fb1f0138960 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb1e8001c00 con 0x7fb1f013f620 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient(hunting): dump: 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.917 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb1e0001a50 con 0x7fb1f0138960 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient(hunting): dump: 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.919 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1978055808 0 0) 0x7fb1f0142ac0 con 0x7fb1f0139450 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 >> v1:172.21.15.73:6792/0 conn(0x7fb1f013f620 legacy=0x7fb1f01d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 >> v1:172.21.15.203:6791/0 conn(0x7fb1f0138960 legacy=0x7fb1f013e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient: _finish_hunting 0 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 monclient: found mon.c 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:47.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f013aca0 con 0x7fb1f0139450 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient: _finish_auth 0 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient: _check_auth_tickets 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1f7556640 5 monclient: authenticate success, global_id 5791 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1f7556640 10 monclient: _renew_subs 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1f7556640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f013c6b0 con 0x7fb1f0139450 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1e4003c40 con 0x7fb1f0139450 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb1e40041f0 con 0x7fb1f0139450 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:47.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1edffb640 10 monclient: dump: 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.922 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1f7556640 10 monclient: _renew_subs 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1f7556640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb1f013e900 con 0x7fb1f0139450 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.896+0000 7fb1ef7fe640 4 set_mon_vals no callback set 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fb1e4004410 con 0x7fb1f0139450 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1f7556640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb1f013b190 con 0x7fb1f00a1420 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(216..216 src has 1..216) ==== 3898+0+0 (unknown 1149619058 0 0) 0x7fb1e404e810 con 0x7fb1f0139450 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576358171 0 0) 0x7fb1f013b190 con 0x7fb1f00a1420 2024-09-11T02:02:47.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 10 monclient(hunting): my global_id is 6003 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f0142ac0 con 0x7fb1f00a1420 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1f5af3640 10 monclient: get_auth_request con 0x7fb1dc040790 auth_method 0 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1212107377 0 0) 0x7fb1f0142ac0 con 0x7fb1f00a1420 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1f013b190 con 0x7fb1f00a1420 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb1e0003930 con 0x7fb1f00a1420 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 10 monclient: dump: 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.924 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2524383848 0 0) 0x7fb1f013b190 con 0x7fb1f00a1420 2024-09-11T02:02:47.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.897+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1f00008d0 con 0x7fb1f00a1420 2024-09-11T02:02:47.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.898+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb1e0003cd0 con 0x7fb1f00a1420 2024-09-11T02:02:47.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.898+0000 7fb1edffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:47.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.898+0000 7fb1edffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:47.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.898+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 >> v1:172.21.15.73:6789/0 conn(0x7fb1f00a1420 legacy=0x7fb1f0063d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.898+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 >> v1:172.21.15.73:6789/0 conn(0x7fb1f00a1420 legacy=0x7fb1f0063d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1f7556640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb1f00a3c50 con 0x7fb1f0143130 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503588093 0 0) 0x7fb1f00a3c50 con 0x7fb1f0143130 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 10 monclient(hunting): my global_id is 6012 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f013b190 con 0x7fb1f0143130 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3052852038 0 0) 0x7fb1f013b190 con 0x7fb1f0143130 2024-09-11T02:02:47.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1f00a3c50 con 0x7fb1f0143130 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb1e0004470 con 0x7fb1f0143130 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 10 monclient: dump: 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:47.929 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1776645935 0 0) 0x7fb1f00a3c50 con 0x7fb1f0143130 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.904+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 --> v1:172.21.15.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb1f0064460 con 0x7fb1f0143130 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 311540647) 0x7fb1e0005960 con 0x7fb1f0143130 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1edffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1edffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:47.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 >> v1:172.21.15.73:6789/0 conn(0x7fb1f0143130 legacy=0x7fb1f00a3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1edffb640 1 -- 172.21.15.73:0/3020632221 >> v1:172.21.15.73:6789/0 conn(0x7fb1f0143130 legacy=0x7fb1f00a3540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:47.931 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:47.931 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:47.931 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:47.931 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:47.931 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:47.931 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 290344, 2024-09-11T02:02:47.931 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:47.931 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 3, 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:47.932 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:47.933 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:47.934 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:47.935 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:47.936 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:47.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:47.938 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:47.939 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:47.940 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:47.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:47.942 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:47.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.943 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:47.943 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:47.943 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:47.943 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:47.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.943 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:47.943 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.944 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:47.945 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:47.946 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:47.947 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:47.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:47.950 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:47.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:47.952 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:47.952 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:47.952 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:47.952 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:47.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 >> v1:172.21.15.203:6812/2311533528 conn(0x7fb1dc040790 legacy=0x7fb1dc042c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f7556640 10 monclient: shutdown 2024-09-11T02:02:47.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f7556640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:47.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 >> v1:172.21.15.73:6791/0 conn(0x7fb1f0139450 legacy=0x7fb1f01d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:47.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f5af3640 1 -- 172.21.15.73:0/3020632221 reap_dead start 2024-09-11T02:02:47.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f5af3640 1 -- 172.21.15.73:0/3020632221 reap_dead start 2024-09-11T02:02:47.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 shutdown_connections 2024-09-11T02:02:47.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 >> 172.21.15.73:0/3020632221 conn(0x7fb1f00a8050 msgr2=0x7fb1f0141bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:47.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 shutdown_connections 2024-09-11T02:02:47.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:47.905+0000 7fb1f7556640 1 -- 172.21.15.73:0/3020632221 wait complete. 2024-09-11T02:02:47.954 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:47.954 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-11T02:02:47.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T02:02:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.051+0000 7fd78d841640 10 monclient: get_monmap_and_config 2024-09-11T02:02:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.051+0000 7fd78d841640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.051+0000 7fd78d841640 10 monclient: monmap: 2024-09-11T02:02:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.053 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:48.052752+0000 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:48.052752+0000 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.054 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 1 Processor -- start 2024-09-11T02:02:48.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 1 -- start start 2024-09-11T02:02:48.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 10 monclient: init 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 10 monclient: _add_conns ranks=[3,5,1,0,6,4,8,2,7] 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 10 monclient(hunting): picked mon.noname-g con 0x7fd7880a5b30 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 10 monclient(hunting): picked mon.noname-h con 0x7fd7880a6620 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 10 monclient(hunting): picked mon.noname-f con 0x7fd78809db70 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7880a7490 con 0x7fd78809db70 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78809ca00 con 0x7fd7880a5b30 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78806fbf0 con 0x7fd7880a6620 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.052+0000 7fd78d841640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd78d841640 10 monclient(hunting): authenticate will time out at 1009.657010s 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd7867fc640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7fd7880a6620 0x7fd78813dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.73:59478/0 (socket says 172.21.15.73:59478) 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd7867fc640 1 -- 172.21.15.73:0/673420331 learned_addr learned my addr 172.21.15.73:0/673420331 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899191955 0 0) 0x7fd78806fbf0 con 0x7fd7880a6620 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): my global_id is 6035 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd770003520 con 0x7fd7880a6620 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955358105 0 0) 0x7fd7880a7490 con 0x7fd78809db70 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): my global_id is 5671 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd78806fbf0 con 0x7fd78809db70 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669815803 0 0) 0x7fd78809ca00 con 0x7fd7880a5b30 2024-09-11T02:02:48.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient(hunting): my global_id is 5862 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7880a7490 con 0x7fd7880a5b30 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1160762075 0 0) 0x7fd770003520 con 0x7fd7880a6620 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 >> v1:172.21.15.203:6790/0 conn(0x7fd7880a5b30 legacy=0x7fd7880a5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 >> v1:172.21.15.203:6789/0 conn(0x7fd78809db70 legacy=0x7fd788141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 monclient: found mon.noname-h 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.203:6791/0 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 --> v1:172.21.15.203:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78809ceb0 con 0x7fd7880a6620 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd78d841640 5 monclient: authenticate success, global_id 6035 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd77c001bd0 con 0x7fd7880a6620 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd78d841640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd785ffb640 10 monclient: dump: 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.067 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.053+0000 7fd78d841640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 <== mon.5 v1:172.21.15.203:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd77c001df0 con 0x7fd7880a6620 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd785ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd78d841640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd78d841640 4 set_mon_vals no callback set 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd785ffb640 1 -- 172.21.15.73:0/673420331 <== mon.5 v1:172.21.15.203:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd77c004f60 con 0x7fd7880a6620 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd785ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd785ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd785ffb640 10 monclient: dump: 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.069 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd78d841640 10 monclient: shutdown 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd78d841640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd78d841640 1 -- 172.21.15.73:0/673420331 >> v1:172.21.15.203:6791/0 conn(0x7fd7880a6620 legacy=0x7fd78813dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd78d841640 1 -- 172.21.15.73:0/673420331 shutdown_connections 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd78d841640 1 -- 172.21.15.73:0/673420331 >> 172.21.15.73:0/673420331 conn(0x7fd7880abe30 msgr2=0x7fd7880a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd78d841640 1 -- 172.21.15.73:0/673420331 shutdown_connections 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.054+0000 7fd78d841640 1 -- 172.21.15.73:0/673420331 wait complete. 2024-09-11T02:02:48.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.055+0000 7fd78d841640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.055+0000 7fd78d841640 10 monclient: monmap: 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.071 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.055+0000 7fd78d841640 1 Processor -- start 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.055+0000 7fd78d841640 1 -- start start 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.055+0000 7fd78d841640 10 monclient: init 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.055+0000 7fd78d841640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.055+0000 7fd78d841640 10 monclient: _add_conns ranks=[7,8,1,5,6,3,4,0,2] 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.055+0000 7fd78d841640 10 monclient(hunting): picked mon.noname-i con 0x7fd7880a5b30 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.055+0000 7fd78d841640 10 monclient(hunting): picked mon.noname-e con 0x7fd7880a6620 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 10 monclient(hunting): picked mon.noname-f con 0x7fd7881d3cd0 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:48.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd788128ec0 con 0x7fd7881d3cd0 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd788126330 con 0x7fd7880a5b30 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd788129650 con 0x7fd7880a6620 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 10 monclient(hunting): authenticate will time out at 1009.660055s 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd7867fc640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fd7880a6620 0x7fd788125c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35394/0 (socket says 172.21.15.73:35394) 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd7867fc640 1 -- 172.21.15.73:0/1785184571 learned_addr learned my addr 172.21.15.73:0/1785184571 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828380150 0 0) 0x7fd788129650 con 0x7fd7880a6620 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): my global_id is 114965 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd774003520 con 0x7fd7880a6620 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604921418 0 0) 0x7fd788126330 con 0x7fd7880a5b30 2024-09-11T02:02:48.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): my global_id is 5839 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd788129650 con 0x7fd7880a5b30 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3100253384 0 0) 0x7fd788128ec0 con 0x7fd7881d3cd0 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): my global_id is 5680 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd788126330 con 0x7fd7881d3cd0 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1138762856 0 0) 0x7fd774003520 con 0x7fd7880a6620 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd788128ec0 con 0x7fd7880a6620 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2586716250 0 0) 0x7fd788129650 con 0x7fd7880a5b30 2024-09-11T02:02:48.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd774003520 con 0x7fd7880a5b30 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd77c001fa0 con 0x7fd7880a6620 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): dump: 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.075 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd780001a50 con 0x7fd7880a5b30 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): dump: 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.076 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.077 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4237262401 0 0) 0x7fd788126330 con 0x7fd7881d3cd0 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd788129650 con 0x7fd7881d3cd0 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd778001430 con 0x7fd7881d3cd0 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient(hunting): dump: 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.078 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1160646972 0 0) 0x7fd788128ec0 con 0x7fd7880a6620 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 >> v1:172.21.15.203:6792/0 conn(0x7fd7880a5b30 legacy=0x7fd788125510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 >> v1:172.21.15.203:6789/0 conn(0x7fd7881d3cd0 legacy=0x7fd7881d60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 monclient: found mon.e 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7881291a0 con 0x7fd7880a6620 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 5 monclient: authenticate success, global_id 114965 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 10 monclient: _renew_subs 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd78806e960 con 0x7fd7880a6620 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 10 monclient: _renew_subs 2024-09-11T02:02:48.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fd788128330 con 0x7fd7880a6620 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd77c005150 con 0x7fd7880a6620 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd77c001df0 con 0x7fd7880a6620 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd7857fa640 4 set_mon_vals no callback set 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.056+0000 7fd76ffff640 10 monclient: dump: 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.081 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.057+0000 7fd78d841640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.057+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd7680065c0 con 0x7fd768002860 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.057+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fd77c011be0 con 0x7fd7880a6620 2024-09-11T02:02:48.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.057+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(216..216 src has 1..216) ==== 3898+0+0 (unknown 1149619058 0 0) 0x7fd77c04e740 con 0x7fd7880a6620 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780040807 0 0) 0x7fd7680065c0 con 0x7fd768002860 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 10 monclient(hunting): my global_id is 134174 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd788128ec0 con 0x7fd768002860 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd7877fe640 10 monclient: get_auth_request con 0x7fd774040860 auth_method 0 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4120863623 0 0) 0x7fd788128ec0 con 0x7fd768002860 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7680065c0 con 0x7fd768002860 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd780003b40 con 0x7fd768002860 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:48.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 10 monclient: dump: 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.084 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1655168834 0 0) 0x7fd7680065c0 con 0x7fd768002860 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd76800a160 con 0x7fd768002860 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd780006480 con 0x7fd768002860 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 >> v1:172.21.15.73:6790/0 conn(0x7fd768002860 legacy=0x7fd768004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.058+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 >> v1:172.21.15.73:6790/0 conn(0x7fd768002860 legacy=0x7fd768004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.064+0000 7fd78d841640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.064+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd768009e00 con 0x7fd7680090e0 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2170180313 0 0) 0x7fd768009e00 con 0x7fd7680090e0 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 10 monclient(hunting): my global_id is 134183 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7680065c0 con 0x7fd7680090e0 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 431358802 0 0) 0x7fd7680065c0 con 0x7fd7680090e0 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd768009e00 con 0x7fd7680090e0 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd780004670 con 0x7fd7680090e0 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 10 monclient: dump: 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.088 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 100067985 0 0) 0x7fd768009e00 con 0x7fd7680090e0 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 --> v1:172.21.15.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd76800c3a0 con 0x7fd7680090e0 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7542 (unknown 0 0 1287566031) 0x7fd780005b00 con 0x7fd7680090e0 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 >> v1:172.21.15.73:6790/0 conn(0x7fd7680090e0 legacy=0x7fd768009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd76ffff640 1 -- 172.21.15.73:0/1785184571 >> v1:172.21.15.73:6790/0 conn(0x7fd7680090e0 legacy=0x7fd768009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.089 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 3767, 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:48.090 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 3, 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.091 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.092 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:48.093 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:48.094 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.095 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:48.096 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:48.097 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.098 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.099 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.100 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:48.101 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.102 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.103 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.105 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.106 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.107 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.108 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:48.109 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 >> v1:172.21.15.203:6812/2311533528 conn(0x7fd774040860 legacy=0x7fd774042d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd78d841640 10 monclient: shutdown 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd78d841640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 >> v1:172.21.15.73:6793/0 conn(0x7fd7880a6620 legacy=0x7fd788125c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.065+0000 7fd7877fe640 1 -- 172.21.15.73:0/1785184571 reap_dead start 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.066+0000 7fd7877fe640 1 -- 172.21.15.73:0/1785184571 reap_dead start 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.066+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 shutdown_connections 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.066+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 >> 172.21.15.73:0/1785184571 conn(0x7fd78809db70 msgr2=0x7fd7880a4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.066+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 shutdown_connections 2024-09-11T02:02:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.066+0000 7fd78d841640 1 -- 172.21.15.73:0/1785184571 wait complete. 2024-09-11T02:02:48.112 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:48.112 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-11T02:02:48.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T02:02:48.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.208+0000 7fb505b6b640 10 monclient: get_monmap_and_config 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.208+0000 7fb505b6b640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.208+0000 7fb505b6b640 10 monclient: monmap: 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:48.209169+0000 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:48.209169+0000 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.210 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.211 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.211 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.211 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.211 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.211 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.211 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.211 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.211 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 1 Processor -- start 2024-09-11T02:02:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 1 -- start start 2024-09-11T02:02:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 10 monclient: init 2024-09-11T02:02:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 10 monclient: _add_conns ranks=[1,0,2,3,8,5,7,6,4] 2024-09-11T02:02:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 10 monclient(hunting): picked mon.noname-f con 0x7fb500138e40 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 10 monclient(hunting): picked mon.noname-a con 0x7fb500139220 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 10 monclient(hunting): picked mon.noname-b con 0x7fb50013f250 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:48.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50009d190 con 0x7fb500139220 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50009e280 con 0x7fb500138e40 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50009ceb0 con 0x7fb50013f250 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb505b6b640 10 monclient(hunting): authenticate will time out at 1009.813638s 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb4f6ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb500139220 0x7fb50013db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47242/0 (socket says 172.21.15.73:47242) 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb4fffff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb50013f250 0x7fb500141640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38658/0 (socket says 172.21.15.73:38658) 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb4f6ffd640 1 -- 172.21.15.73:0/3365216715 learned_addr learned my addr 172.21.15.73:0/3365216715 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598298264 0 0) 0x7fb4e8001110 con 0x7fb500139220 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb4feffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb4feffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.209+0000 7fb4feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient(hunting): my global_id is 6021 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4ec003520 con 0x7fb500139220 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793168090 0 0) 0x7fb50009ceb0 con 0x7fb50013f250 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient(hunting): my global_id is 134192 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e8001110 con 0x7fb50013f250 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3560436489 0 0) 0x7fb4ec003520 con 0x7fb500139220 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 >> v1:172.21.15.73:6790/0 conn(0x7fb50013f250 legacy=0x7fb500141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 >> v1:172.21.15.203:6789/0 conn(0x7fb500138e40 legacy=0x7fb50009db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 monclient: found mon.noname-a 2024-09-11T02:02:48.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50009d470 con 0x7fb500139220 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4e8001a00 con 0x7fb500139220 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 5 monclient: authenticate success, global_id 6021 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: dump: 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.224 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.225 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4e8001ba0 con 0x7fb500139220 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 1 -- 172.21.15.73:0/3365216715 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4e8004be0 con 0x7fb500139220 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 4 set_mon_vals no callback set 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb4feffd640 10 monclient: dump: 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 10 monclient: shutdown 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 1 -- 172.21.15.73:0/3365216715 >> v1:172.21.15.73:6789/0 conn(0x7fb500139220 legacy=0x7fb50013db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 1 -- 172.21.15.73:0/3365216715 shutdown_connections 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 1 -- 172.21.15.73:0/3365216715 >> 172.21.15.73:0/3365216715 conn(0x7fb5000abe10 msgr2=0x7fb5000a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 1 -- 172.21.15.73:0/3365216715 shutdown_connections 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.210+0000 7fb505b6b640 1 -- 172.21.15.73:0/3365216715 wait complete. 2024-09-11T02:02:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.211+0000 7fb505b6b640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.211+0000 7fb505b6b640 10 monclient: monmap: 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.229 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.211+0000 7fb505b6b640 1 Processor -- start 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.211+0000 7fb505b6b640 1 -- start start 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.211+0000 7fb505b6b640 10 monclient: init 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 10 monclient: _add_conns ranks=[2,7,3,6,5,4,8,0,1] 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 10 monclient(hunting): picked mon.noname-b con 0x7fb500138e40 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:48.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 10 monclient(hunting): picked mon.noname-i con 0x7fb500139220 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 10 monclient(hunting): picked mon.noname-g con 0x7fb50013f250 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb500142a90 con 0x7fb500138e40 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50013ae30 con 0x7fb50013f250 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50013b3f0 con 0x7fb500139220 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb505b6b640 10 monclient(hunting): authenticate will time out at 1009.816439s 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4ff7fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb500138e40 0x7fb5001cdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38672/0 (socket says 172.21.15.73:38672) 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4ff7fe640 1 -- 172.21.15.73:0/3613088978 learned_addr learned my addr 172.21.15.73:0/3613088978 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785169266 0 0) 0x7fb50009e280 con 0x7fb500138e40 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): my global_id is 134201 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e0003520 con 0x7fb500138e40 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292617837 0 0) 0x7fb50013ae30 con 0x7fb50013f250 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): my global_id is 5871 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb50009e280 con 0x7fb50013f250 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1690667999 0 0) 0x7fb4e0003520 con 0x7fb500138e40 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb50013ae30 con 0x7fb500138e40 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031605396 0 0) 0x7fb50013b3f0 con 0x7fb500139220 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): my global_id is 5848 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4e0003520 con 0x7fb500139220 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4f0001b50 con 0x7fb500138e40 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.212+0000 7fb4fcff9640 10 monclient(hunting): dump: 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.233 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4180407292 0 0) 0x7fb50013ae30 con 0x7fb500138e40 2024-09-11T02:02:48.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 >> v1:172.21.15.203:6792/0 conn(0x7fb500139220 legacy=0x7fb5001d2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 >> v1:172.21.15.203:6790/0 conn(0x7fb50013f250 legacy=0x7fb5001d65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 1 monclient: found mon.b 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb500142660 con 0x7fb500138e40 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb505b6b640 5 monclient: authenticate success, global_id 134201 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb505b6b640 10 monclient: _renew_subs 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb505b6b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb50013ab50 con 0x7fb500138e40 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb505b6b640 10 monclient: _renew_subs 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb505b6b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5000a4320 con 0x7fb500138e40 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4f00038c0 con 0x7fb500138e40 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4f0003eb0 con 0x7fb500138e40 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 10 monclient: dump: 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.236 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.237 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fe7fc640 4 set_mon_vals no callback set 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.213+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fb4f00040d0 con 0x7fb500138e40 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb505b6b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(216..216 src has 1..216) ==== 3898+0+0 (unknown 1149619058 0 0) 0x7fb4f004e4f0 con 0x7fb500138e40 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb50009def0 con 0x7fb5001ce5d0 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4f6ffd640 10 monclient: get_auth_request con 0x7fb4e003ff20 auth_method 0 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1510021998 0 0) 0x7fb50009def0 con 0x7fb5001ce5d0 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 10 monclient(hunting): my global_id is 5800 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb50013ae30 con 0x7fb5001ce5d0 2024-09-11T02:02:48.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3831883720 0 0) 0x7fb50013ae30 con 0x7fb5001ce5d0 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb50009def0 con 0x7fb5001ce5d0 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4f8001c80 con 0x7fb5001ce5d0 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 10 monclient: dump: 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.239 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3468228352 0 0) 0x7fb50009def0 con 0x7fb5001ce5d0 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.214+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb500142d30 con 0x7fb5001ce5d0 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.215+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb4f8001fb0 con 0x7fb5001ce5d0 2024-09-11T02:02:48.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.215+0000 7fb4fcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.215+0000 7fb4fcff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:48.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.215+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 >> v1:172.21.15.73:6791/0 conn(0x7fb5001ce5d0 legacy=0x7fb50009eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.215+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 >> v1:172.21.15.73:6791/0 conn(0x7fb5001ce5d0 legacy=0x7fb50009eb10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb505b6b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:48.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb5000a6d40 con 0x7fb50002e450 2024-09-11T02:02:48.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033236426 0 0) 0x7fb5000a6d40 con 0x7fb50002e450 2024-09-11T02:02:48.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 10 monclient(hunting): my global_id is 5809 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb50009def0 con 0x7fb50002e450 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3429796611 0 0) 0x7fb50009def0 con 0x7fb50002e450 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5000a6d40 con 0x7fb50002e450 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb4f8005090 con 0x7fb50002e450 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 10 monclient: dump: 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.243 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2678075262 0 0) 0x7fb5000a6d40 con 0x7fb50002e450 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 --> v1:172.21.15.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb5000696e0 con 0x7fb50002e450 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 85249093) 0x7fb4f8007290 con 0x7fb50002e450 2024-09-11T02:02:48.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:48.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:48.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 >> v1:172.21.15.73:6791/0 conn(0x7fb50002e450 legacy=0x7fb50009f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.221+0000 7fb4fcff9640 1 -- 172.21.15.73:0/3613088978 >> v1:172.21.15.73:6791/0 conn(0x7fb50002e450 legacy=0x7fb50009f220 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.245 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:48.245 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:48.245 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:48.245 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:48.245 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:48.245 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 290684, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 3, 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.246 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.247 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.248 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:48.249 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.250 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.251 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.253 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.254 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:48.255 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.256 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.257 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:48.258 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:48.265 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:48.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.222+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 >> v1:172.21.15.203:6812/2311533528 conn(0x7fb4e003ff20 legacy=0x7fb4e00423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.222+0000 7fb505b6b640 10 monclient: shutdown 2024-09-11T02:02:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.222+0000 7fb505b6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.222+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 >> v1:172.21.15.73:6790/0 conn(0x7fb500138e40 legacy=0x7fb5001cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.222+0000 7fb4fffff640 1 -- 172.21.15.73:0/3613088978 reap_dead start 2024-09-11T02:02:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.222+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 shutdown_connections 2024-09-11T02:02:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.222+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 >> 172.21.15.73:0/3613088978 conn(0x7fb5000abe10 msgr2=0x7fb5000a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.222+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 shutdown_connections 2024-09-11T02:02:48.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.222+0000 7fb505b6b640 1 -- 172.21.15.73:0/3613088978 wait complete. 2024-09-11T02:02:48.267 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:48.267 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-11T02:02:48.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-11T02:02:48.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.366+0000 7fef629a3640 10 monclient: get_monmap_and_config 2024-09-11T02:02:48.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.366+0000 7fef629a3640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.366+0000 7fef629a3640 10 monclient: monmap: 2024-09-11T02:02:48.368 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:48.367690+0000 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:48.367690+0000 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.370 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.367+0000 7fef629a3640 1 Processor -- start 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.367+0000 7fef629a3640 1 -- start start 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.367+0000 7fef629a3640 10 monclient: init 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 10 monclient: _add_conns ranks=[8,2,4,1,7,5,3,0,6] 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 10 monclient(hunting): picked mon.noname-e con 0x7fef5c138d40 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 10 monclient(hunting): picked mon.noname-b con 0x7fef5c0a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 10 monclient(hunting): picked mon.noname-c con 0x7fef5c13f350 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c09ca00 con 0x7fef5c0a72f0 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c0a7070 con 0x7fef5c13f350 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c09cee0 con 0x7fef5c138d40 2024-09-11T02:02:48.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 10 monclient(hunting): authenticate will time out at 1009.972285s 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5bfff640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fef5c138d40 0x7fef5c139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35396/0 (socket says 172.21.15.73:35396) 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5bfff640 1 -- 172.21.15.73:0/2091215226 learned_addr learned my addr 172.21.15.73:0/2091215226 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975263617 0 0) 0x7fef5c09cee0 con 0x7fef5c138d40 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): my global_id is 114974 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef44003520 con 0x7fef5c138d40 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853065847 0 0) 0x7fef5c0a7070 con 0x7fef5c13f350 2024-09-11T02:02:48.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): my global_id is 5818 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef5c09cee0 con 0x7fef5c13f350 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2539906522 0 0) 0x7fef5c09ca00 con 0x7fef5c0a72f0 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient(hunting): my global_id is 134210 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef5c0a7070 con 0x7fef5c0a72f0 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1485386801 0 0) 0x7fef44003520 con 0x7fef5c138d40 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 >> v1:172.21.15.73:6791/0 conn(0x7fef5c13f350 legacy=0x7fef5c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 >> v1:172.21.15.73:6790/0 conn(0x7fef5c0a72f0 legacy=0x7fef5c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 monclient: found mon.noname-e 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c09d1c0 con 0x7fef5c138d40 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fef4c001830 con 0x7fef5c138d40 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef5affd640 10 monclient: dump: 2024-09-11T02:02:48.381 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.382 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 5 monclient: authenticate success, global_id 114974 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.368+0000 7fef629a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef4c0019d0 con 0x7fef5c138d40 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef5affd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef5affd640 1 -- 172.21.15.73:0/2091215226 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fef4c001c40 con 0x7fef5c138d40 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef629a3640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef629a3640 4 set_mon_vals no callback set 2024-09-11T02:02:48.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef5affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef5affd640 10 monclient: dump: 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.384 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef629a3640 10 monclient: shutdown 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef629a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef629a3640 1 -- 172.21.15.73:0/2091215226 >> v1:172.21.15.73:6793/0 conn(0x7fef5c138d40 legacy=0x7fef5c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef629a3640 1 -- 172.21.15.73:0/2091215226 shutdown_connections 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef629a3640 1 -- 172.21.15.73:0/2091215226 >> 172.21.15.73:0/2091215226 conn(0x7fef5c0a8050 msgr2=0x7fef5c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef629a3640 1 -- 172.21.15.73:0/2091215226 shutdown_connections 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.369+0000 7fef629a3640 1 -- 172.21.15.73:0/2091215226 wait complete. 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.370+0000 7fef629a3640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.370+0000 7fef629a3640 10 monclient: monmap: 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.386 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.370+0000 7fef629a3640 1 Processor -- start 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.370+0000 7fef629a3640 1 -- start start 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.370+0000 7fef629a3640 10 monclient: init 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient: _add_conns ranks=[2,3,5,1,7,8,0,4,6] 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient(hunting): picked mon.noname-b con 0x7fef5c0a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient(hunting): picked mon.noname-g con 0x7fef5c138d40 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient(hunting): picked mon.noname-h con 0x7fef5c13f350 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c0a5050 con 0x7fef5c0a72f0 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c142960 con 0x7fef5c138d40 2024-09-11T02:02:48.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5c1426d0 con 0x7fef5c13f350 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef5bfff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fef5c0a72f0 0x7fef5c13e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38696/0 (socket says 172.21.15.73:38696) 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient(hunting): authenticate will time out at 1009.975221s 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef5bfff640 1 -- 172.21.15.73:0/187383615 learned_addr learned my addr 172.21.15.73:0/187383615 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799761434 0 0) 0x7fef5c0a5050 con 0x7fef5c0a72f0 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient(hunting): my global_id is 134219 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef48003520 con 0x7fef5c0a72f0 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4186931190 0 0) 0x7fef48003520 con 0x7fef5c0a72f0 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef5c0a5050 con 0x7fef5c0a72f0 2024-09-11T02:02:48.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fef4c0016f0 con 0x7fef5c0a72f0 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient(hunting): dump: 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.389 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3962315337 0 0) 0x7fef5c0a5050 con 0x7fef5c0a72f0 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 >> v1:172.21.15.203:6791/0 conn(0x7fef5c13f350 legacy=0x7fef5c1d5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 >> v1:172.21.15.203:6790/0 conn(0x7fef5c138d40 legacy=0x7fef5c1d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 monclient: found mon.b 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5c13c250 con 0x7fef5c0a72f0 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 5 monclient: authenticate success, global_id 134219 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient: _renew_subs 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fef5c1cd6c0 con 0x7fef5c0a72f0 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient: _renew_subs 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fef5c13b2f0 con 0x7fef5c0a72f0 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef4c004f30 con 0x7fef5c0a72f0 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fef4c005420 con 0x7fef5c0a72f0 2024-09-11T02:02:48.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef5a7fc640 4 set_mon_vals no callback set 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.371+0000 7fef58ff9640 10 monclient: dump: 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.392 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.372+0000 7fef629a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.372+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fef3c0065c0 con 0x7fef3c002860 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.372+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fef4c011b60 con 0x7fef5c0a72f0 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(216..216 src has 1..216) ==== 3898+0+0 (unknown 1149619058 0 0) 0x7fef4c04e5e0 con 0x7fef5c0a72f0 2024-09-11T02:02:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483875473 0 0) 0x7fef3c0065c0 con 0x7fef3c002860 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 10 monclient(hunting): my global_id is 114981 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef5c0a5050 con 0x7fef3c002860 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef60f40640 10 monclient: get_auth_request con 0x7fef4803fc50 auth_method 0 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 430970079 0 0) 0x7fef5c0a5050 con 0x7fef3c002860 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef3c0065c0 con 0x7fef3c002860 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fef50001210 con 0x7fef3c002860 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 10 monclient: dump: 2024-09-11T02:02:48.394 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.395 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2372895264 0 0) 0x7fef3c0065c0 con 0x7fef3c002860 2024-09-11T02:02:48.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef3c00a160 con 0x7fef3c002860 2024-09-11T02:02:48.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fef50001490 con 0x7fef3c002860 2024-09-11T02:02:48.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:48.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 >> v1:172.21.15.73:6792/0 conn(0x7fef3c002860 legacy=0x7fef3c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.373+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 >> v1:172.21.15.73:6792/0 conn(0x7fef3c002860 legacy=0x7fef3c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.379+0000 7fef629a3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.379+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fef3c009e70 con 0x7fef3c009130 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417623480 0 0) 0x7fef3c009e70 con 0x7fef3c009130 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 10 monclient(hunting): my global_id is 114990 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef3c0065c0 con 0x7fef3c009130 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 340622831 0 0) 0x7fef3c0065c0 con 0x7fef3c009130 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef3c009e70 con 0x7fef3c009130 2024-09-11T02:02:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fef500039b0 con 0x7fef3c009130 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 10 monclient: dump: 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3089712186 0 0) 0x7fef3c009e70 con 0x7fef3c009130 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 --> v1:172.21.15.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fef3c00c410 con 0x7fef3c009130 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 2302421738) 0x7fef50004f00 con 0x7fef3c009130 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 >> v1:172.21.15.73:6792/0 conn(0x7fef3c009130 legacy=0x7fef3c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.380+0000 7fef58ff9640 1 -- 172.21.15.73:0/187383615 >> v1:172.21.15.73:6792/0 conn(0x7fef3c009130 legacy=0x7fef3c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 134969, 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:48.401 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.402 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.403 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.404 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.405 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.406 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.408 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:48.409 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:48.410 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.411 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.412 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.413 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.414 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.416 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:48.417 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.418 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.419 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:48.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.420 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.420 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.420 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.420 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.420 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.420 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:48.420 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 >> v1:172.21.15.203:6812/2311533528 conn(0x7fef4803fc50 legacy=0x7fef48042110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef629a3640 10 monclient: shutdown 2024-09-11T02:02:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef629a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 >> v1:172.21.15.73:6790/0 conn(0x7fef5c0a72f0 legacy=0x7fef5c13e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef60f40640 1 -- 172.21.15.73:0/187383615 reap_dead start 2024-09-11T02:02:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef60f40640 1 -- 172.21.15.73:0/187383615 reap_dead start 2024-09-11T02:02:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 shutdown_connections 2024-09-11T02:02:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 >> 172.21.15.73:0/187383615 conn(0x7fef5c0a8050 msgr2=0x7fef5c0a4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 shutdown_connections 2024-09-11T02:02:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.381+0000 7fef629a3640 1 -- 172.21.15.73:0/187383615 wait complete. 2024-09-11T02:02:48.422 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:48.423 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-11T02:02:48.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-11T02:02:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.520+0000 7f2970495640 10 monclient: get_monmap_and_config 2024-09-11T02:02:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.520+0000 7f2970495640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.520+0000 7f2970495640 10 monclient: monmap: 2024-09-11T02:02:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.522 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:48.521400+0000 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:48.521400+0000 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.523 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 1 Processor -- start 2024-09-11T02:02:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 1 -- start start 2024-09-11T02:02:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 10 monclient: init 2024-09-11T02:02:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 10 monclient: _add_conns ranks=[5,6,2,1,8,4,3,0,7] 2024-09-11T02:02:48.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 10 monclient(hunting): picked mon.noname-h con 0x7f2968138d40 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 10 monclient(hunting): picked mon.noname-d con 0x7f29680a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 10 monclient(hunting): picked mon.noname-b con 0x7f296813f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296809ca00 con 0x7f296813f350 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29680a7070 con 0x7f2968138d40 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296809cee0 con 0x7f29680a72f0 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f2970495640 10 monclient(hunting): authenticate will time out at 1010.125835s 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f296da30640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f29680a72f0 0x7f296813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:40002/0 (socket says 172.21.15.73:40002) 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.521+0000 7f296da30640 1 -- 172.21.15.73:0/1866998121 learned_addr learned my addr 172.21.15.73:0/1866998121 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743305949 0 0) 0x7f296809cee0 con 0x7f29680a72f0 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): my global_id is 114999 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2954003520 con 0x7f29680a72f0 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439727415 0 0) 0x7f296809ca00 con 0x7f296813f350 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): my global_id is 134228 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f296809cee0 con 0x7f296813f350 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275676451 0 0) 0x7f29680a7070 con 0x7f2968138d40 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient(hunting): my global_id is 6053 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f296809ca00 con 0x7f2968138d40 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 26548774 0 0) 0x7f2954003520 con 0x7f29680a72f0 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 >> v1:172.21.15.203:6791/0 conn(0x7f2968138d40 legacy=0x7f2968139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 >> v1:172.21.15.73:6790/0 conn(0x7f296813f350 legacy=0x7f2968141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 monclient: found mon.noname-d 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296809d1c0 con 0x7f29680a72f0 2024-09-11T02:02:48.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2958001830 con 0x7f29680a72f0 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f2970495640 5 monclient: authenticate success, global_id 114999 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f2970495640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: dump: 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.535 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f2970495640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2958001a50 con 0x7f29680a72f0 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 1 -- 172.21.15.73:0/1866998121 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2958004be0 con 0x7f29680a72f0 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f2970495640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f2970495640 4 set_mon_vals no callback set 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f296d22f640 10 monclient: dump: 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.537 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f2970495640 10 monclient: shutdown 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f2970495640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.522+0000 7f2970495640 1 -- 172.21.15.73:0/1866998121 >> v1:172.21.15.73:6792/0 conn(0x7f29680a72f0 legacy=0x7f296813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.523+0000 7f2970495640 1 -- 172.21.15.73:0/1866998121 shutdown_connections 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.523+0000 7f2970495640 1 -- 172.21.15.73:0/1866998121 >> 172.21.15.73:0/1866998121 conn(0x7f29680a8050 msgr2=0x7f29680a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.523+0000 7f2970495640 1 -- 172.21.15.73:0/1866998121 shutdown_connections 2024-09-11T02:02:48.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.523+0000 7f2970495640 1 -- 172.21.15.73:0/1866998121 wait complete. 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.523+0000 7f2970495640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.523+0000 7f2970495640 10 monclient: monmap: 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.539 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.523+0000 7f2970495640 1 Processor -- start 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 1 -- start start 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 10 monclient: init 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 10 monclient: _add_conns ranks=[7,2,5,6,4,3,1,8,0] 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 10 monclient(hunting): picked mon.noname-i con 0x7f29680a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 10 monclient(hunting): picked mon.noname-b con 0x7f2968138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 10 monclient(hunting): picked mon.noname-h con 0x7f296813f350 addr v1:172.21.15.203:6791/0 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296813e5d0 con 0x7f2968138d40 2024-09-11T02:02:48.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f296813b620 con 0x7f296813f350 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29680a5230 con 0x7f29680a72f0 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f2970495640 10 monclient(hunting): authenticate will time out at 1010.128510s 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f296da30640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f2968138d40 0x7f2968140e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38712/0 (socket says 172.21.15.73:38712) 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f296da30640 1 -- 172.21.15.73:0/428795381 learned_addr learned my addr 172.21.15.73:0/428795381 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307553447 0 0) 0x7f296813e5d0 con 0x7f2968138d40 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): my global_id is 134237 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f294c003520 con 0x7f2968138d40 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2614761819 0 0) 0x7f294c003520 con 0x7f2968138d40 2024-09-11T02:02:48.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f296813e5d0 con 0x7f2968138d40 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2958004b20 con 0x7f2968138d40 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): dump: 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.542 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646774679 0 0) 0x7f296813b620 con 0x7f296813f350 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 10 monclient(hunting): my global_id is 6062 2024-09-11T02:02:48.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.524+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f294c003520 con 0x7f296813f350 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844359233 0 0) 0x7f29680a5230 con 0x7f29680a72f0 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient(hunting): my global_id is 5857 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f296813b620 con 0x7f29680a72f0 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 199863862 0 0) 0x7f296813e5d0 con 0x7f2968138d40 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 >> v1:172.21.15.203:6792/0 conn(0x7f29680a72f0 legacy=0x7f2968140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 >> v1:172.21.15.203:6791/0 conn(0x7f296813f350 legacy=0x7f29681d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 1 monclient: found mon.b 2024-09-11T02:02:48.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29681420a0 con 0x7f2968138d40 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f2970495640 5 monclient: authenticate success, global_id 134237 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f2970495640 10 monclient: _renew_subs 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f2970495640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2968141550 con 0x7f2968138d40 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f2970495640 10 monclient: _renew_subs 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f2970495640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2968139e20 con 0x7f2968138d40 2024-09-11T02:02:48.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29580011f0 con 0x7f2968138d40 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2958001950 con 0x7f2968138d40 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f296ca2e640 4 set_mon_vals no callback set 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f295effd640 10 monclient: dump: 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.546 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.525+0000 7f2970495640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f29500065c0 con 0x7f2950002860 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f2958011780 con 0x7f2968138d40 2024-09-11T02:02:48.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(216..216 src has 1..216) ==== 3898+0+0 (unknown 1149619058 0 0) 0x7f295804e5e0 con 0x7f2968138d40 2024-09-11T02:02:48.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256695660 0 0) 0x7f29500065c0 con 0x7f2950002860 2024-09-11T02:02:48.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 10 monclient(hunting): my global_id is 114983 2024-09-11T02:02:48.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f296813e5d0 con 0x7f2950002860 2024-09-11T02:02:48.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f296ea32640 10 monclient: get_auth_request con 0x7f294c03fef0 auth_method 0 2024-09-11T02:02:48.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4053506132 0 0) 0x7f296813e5d0 con 0x7f2950002860 2024-09-11T02:02:48.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29500065c0 con 0x7f2950002860 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2964001a20 con 0x7f2950002860 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 10 monclient: dump: 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.549 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3048751191 0 0) 0x7f29500065c0 con 0x7f2950002860 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.526+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f295000a160 con 0x7f2950002860 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.527+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f29640035f0 con 0x7f2950002860 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.527+0000 7f295effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.527+0000 7f295effd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:48.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.527+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 >> v1:172.21.15.73:6793/0 conn(0x7f2950002860 legacy=0x7f2950004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.527+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 >> v1:172.21.15.73:6793/0 conn(0x7f2950002860 legacy=0x7f2950004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f2970495640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:48.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2950009e70 con 0x7f2950009130 2024-09-11T02:02:48.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476940826 0 0) 0x7f2950009e70 con 0x7f2950009130 2024-09-11T02:02:48.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 10 monclient(hunting): my global_id is 114992 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29500065c0 con 0x7f2950009130 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2760339833 0 0) 0x7f29500065c0 con 0x7f2950009130 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2950009e70 con 0x7f2950009130 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2964003cd0 con 0x7f2950009130 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 10 monclient: dump: 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.553 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1876638389 0 0) 0x7f2950009e70 con 0x7f2950009130 2024-09-11T02:02:48.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 --> v1:172.21.15.73:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f295000c410 con 0x7f2950009130 2024-09-11T02:02:48.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 2286036081) 0x7f2964003fb0 con 0x7f2950009130 2024-09-11T02:02:48.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:48.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:48.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.533+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 >> v1:172.21.15.73:6793/0 conn(0x7f2950009130 legacy=0x7f29500095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f295effd640 1 -- 172.21.15.73:0/428795381 >> v1:172.21.15.73:6793/0 conn(0x7f2950009130 legacy=0x7f29500095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.555 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:48.555 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:48.555 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 135122, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:48.556 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.557 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.558 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:48.559 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.560 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:48.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.562 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:48.564 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.565 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:48.571 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.572 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.573 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.574 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.575 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:48.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.576 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.576 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.576 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.576 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.576 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.576 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:48.576 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:48.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 >> v1:172.21.15.203:6812/2311533528 conn(0x7f294c03fef0 legacy=0x7f294c0423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f2970495640 10 monclient: shutdown 2024-09-11T02:02:48.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f2970495640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 >> v1:172.21.15.73:6790/0 conn(0x7f2968138d40 legacy=0x7f2968140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f296ea32640 1 -- 172.21.15.73:0/428795381 reap_dead start 2024-09-11T02:02:48.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f296ea32640 1 -- 172.21.15.73:0/428795381 reap_dead start 2024-09-11T02:02:48.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 shutdown_connections 2024-09-11T02:02:48.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 >> 172.21.15.73:0/428795381 conn(0x7f29680a8050 msgr2=0x7f296813ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 shutdown_connections 2024-09-11T02:02:48.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.534+0000 7f2970495640 1 -- 172.21.15.73:0/428795381 wait complete. 2024-09-11T02:02:48.578 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:48.579 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-11T02:02:48.579 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-11T02:02:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.675+0000 7f441ae08640 10 monclient: get_monmap_and_config 2024-09-11T02:02:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.675+0000 7f441ae08640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.675+0000 7f441ae08640 10 monclient: monmap: 2024-09-11T02:02:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.677 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:48.676680+0000 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:48.676680+0000 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.678 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.676+0000 7f441ae08640 1 Processor -- start 2024-09-11T02:02:48.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.676+0000 7f441ae08640 1 -- start start 2024-09-11T02:02:48.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.676+0000 7f441ae08640 10 monclient: init 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 10 monclient: _add_conns ranks=[0,3,6,2,4,8,1,7,5] 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 10 monclient(hunting): picked mon.noname-a con 0x7f4414138d40 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 10 monclient(hunting): picked mon.noname-g con 0x7f44140a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 10 monclient(hunting): picked mon.noname-d con 0x7f441413f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441409ca00 con 0x7f4414138d40 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44140a7070 con 0x7f44140a72f0 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441409cee0 con 0x7f441413f350 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 10 monclient(hunting): authenticate will time out at 1010.281168s 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44193a5640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f441413f350 0x7f4414141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:40012/0 (socket says 172.21.15.73:40012) 2024-09-11T02:02:48.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44193a5640 1 -- 172.21.15.73:0/2912245979 learned_addr learned my addr 172.21.15.73:0/2912245979 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f4418ba4640 1 --1- 172.21.15.73:0/2912245979 >> v1:172.21.15.73:6789/0 conn(0x7f4414138d40 0x7f4414139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47254/0 (socket says 172.21.15.73:47254) 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069816525 0 0) 0x7f441409ca00 con 0x7f4414138d40 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient(hunting): my global_id is 6030 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43fc003520 con 0x7f4414138d40 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520363600 0 0) 0x7f441409cee0 con 0x7f441413f350 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient(hunting): my global_id is 115008 2024-09-11T02:02:48.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f441409ca00 con 0x7f441413f350 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3148905555 0 0) 0x7f441409ca00 con 0x7f441413f350 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 >> v1:172.21.15.203:6790/0 conn(0x7f44140a72f0 legacy=0x7f441413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 >> v1:172.21.15.73:6789/0 conn(0x7f4414138d40 legacy=0x7f4414139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 monclient: found mon.noname-d 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441409d1c0 con 0x7f441413f350 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f440c001ac0 con 0x7f441413f350 2024-09-11T02:02:48.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 5 monclient: authenticate success, global_id 115008 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: dump: 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.691 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f440c001c60 con 0x7f441413f350 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f441ae08640 4 set_mon_vals no callback set 2024-09-11T02:02:48.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 1 -- 172.21.15.73:0/2912245979 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f440c004c20 con 0x7f441413f350 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.677+0000 7f44137fe640 10 monclient: dump: 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.693 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.678+0000 7f441ae08640 10 monclient: shutdown 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.678+0000 7f441ae08640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.678+0000 7f441ae08640 1 -- 172.21.15.73:0/2912245979 >> v1:172.21.15.73:6792/0 conn(0x7f441413f350 legacy=0x7f4414141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.678+0000 7f441ae08640 1 -- 172.21.15.73:0/2912245979 shutdown_connections 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.678+0000 7f441ae08640 1 -- 172.21.15.73:0/2912245979 >> 172.21.15.73:0/2912245979 conn(0x7f44140a8050 msgr2=0x7f44140a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.678+0000 7f441ae08640 1 -- 172.21.15.73:0/2912245979 shutdown_connections 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.678+0000 7f441ae08640 1 -- 172.21.15.73:0/2912245979 wait complete. 2024-09-11T02:02:48.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.678+0000 7f441ae08640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.678+0000 7f441ae08640 10 monclient: monmap: 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.695 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 1 Processor -- start 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 1 -- start start 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 10 monclient: init 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 10 monclient: _add_conns ranks=[2,3,4,6,1,8,7,0,5] 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 10 monclient(hunting): picked mon.noname-b con 0x7f44140a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 10 monclient(hunting): picked mon.noname-g con 0x7f4414138d40 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:48.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 10 monclient(hunting): picked mon.noname-c con 0x7f441413f350 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44140a19f0 con 0x7f44140a72f0 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441409fa60 con 0x7f4414138d40 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4414142170 con 0x7f441413f350 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.679+0000 7f441ae08640 10 monclient(hunting): authenticate will time out at 1010.283987s 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f4418ba4640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f44140a72f0 0x7f441409ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38720/0 (socket says 172.21.15.73:38720) 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f4418ba4640 1 -- 172.21.15.73:0/77499608 learned_addr learned my addr 172.21.15.73:0/77499608 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260328698 0 0) 0x7f4414142170 con 0x7f441413f350 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): my global_id is 5827 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4400003520 con 0x7f441413f350 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978479799 0 0) 0x7f44140a19f0 con 0x7f44140a72f0 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): my global_id is 134246 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4414142170 con 0x7f44140a72f0 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065357247 0 0) 0x7f441409fa60 con 0x7f4414138d40 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): my global_id is 5898 2024-09-11T02:02:48.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44140a19f0 con 0x7f4414138d40 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 678390677 0 0) 0x7f4400003520 con 0x7f441413f350 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f441409fa60 con 0x7f441413f350 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f440c0019c0 con 0x7f441413f350 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): dump: 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.699 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2310474649 0 0) 0x7f4414142170 con 0x7f44140a72f0 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4400003520 con 0x7f44140a72f0 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f44040014f0 con 0x7f44140a72f0 2024-09-11T02:02:48.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): dump: 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.701 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1004115531 0 0) 0x7f44140a19f0 con 0x7f4414138d40 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4414142170 con 0x7f4414138d40 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4408001a10 con 0x7f4414138d40 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient(hunting): dump: 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.702 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3940528465 0 0) 0x7f441409fa60 con 0x7f441413f350 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 >> v1:172.21.15.203:6790/0 conn(0x7f4414138d40 legacy=0x7f441409f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 >> v1:172.21.15.73:6790/0 conn(0x7f44140a72f0 legacy=0x7f441409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 monclient: found mon.c 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44141427f0 con 0x7f441413f350 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f441ae08640 5 monclient: authenticate success, global_id 5827 2024-09-11T02:02:48.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f441ae08640 10 monclient: _renew_subs 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f441ae08640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44140a1710 con 0x7f441413f350 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f441ae08640 10 monclient: _renew_subs 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f441ae08640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f44140a01f0 con 0x7f441413f350 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f440c001c40 con 0x7f441413f350 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f440c005150 con 0x7f441413f350 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f44117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.680+0000 7f4412ffd640 4 set_mon_vals no callback set 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.681+0000 7f44117fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.681+0000 7f44117fa640 10 monclient: dump: 2024-09-11T02:02:48.705 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.706 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.681+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f440c011890 con 0x7f441413f350 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.681+0000 7f441ae08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.681+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f43f40065c0 con 0x7f43f4002860 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(216..216 src has 1..216) ==== 3898+0+0 (unknown 1149619058 0 0) 0x7f440c04e510 con 0x7f441413f350 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f4413fff640 10 monclient: get_auth_request con 0x7f4400040660 auth_method 0 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180656602 0 0) 0x7f43f40065c0 con 0x7f43f4002860 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 10 monclient(hunting): my global_id is 5698 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f441409fa60 con 0x7f43f4002860 2024-09-11T02:02:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2897285823 0 0) 0x7f441409fa60 con 0x7f43f4002860 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43f40065c0 con 0x7f43f4002860 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4404004e90 con 0x7f43f4002860 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 10 monclient: dump: 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.708 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 95005784 0 0) 0x7f43f40065c0 con 0x7f43f4002860 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.682+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43f400a160 con 0x7f43f4002860 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.683+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f44040063d0 con 0x7f43f4002860 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.683+0000 7f44117fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.683+0000 7f44117fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:48.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.683+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 >> v1:172.21.15.203:6789/0 conn(0x7f43f4002860 legacy=0x7f43f4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.683+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 >> v1:172.21.15.203:6789/0 conn(0x7f43f4002860 legacy=0x7f43f4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.689+0000 7f441ae08640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.689+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f43f4009e70 con 0x7f43f4009130 2024-09-11T02:02:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.689+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118185360 0 0) 0x7f43f4009e70 con 0x7f43f4009130 2024-09-11T02:02:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.689+0000 7f44117fa640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.689+0000 7f44117fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.689+0000 7f44117fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.689+0000 7f44117fa640 10 monclient(hunting): my global_id is 5707 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.689+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43f40065c0 con 0x7f43f4009130 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.689+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1268678160 0 0) 0x7f43f40065c0 con 0x7f43f4009130 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43f4009e70 con 0x7f43f4009130 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4404005500 con 0x7f43f4009130 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 10 monclient: dump: 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1505011155 0 0) 0x7f43f4009e70 con 0x7f43f4009130 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 --> v1:172.21.15.203:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f43f400c410 con 0x7f43f4009130 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7880 (unknown 0 0 424587004) 0x7f44040057d0 con 0x7f43f4009130 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 >> v1:172.21.15.203:6789/0 conn(0x7f43f4009130 legacy=0x7f43f40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44117fa640 1 -- 172.21.15.73:0/77499608 >> v1:172.21.15.203:6789/0 conn(0x7f43f4009130 legacy=0x7f43f40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 291106, 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:48.715 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:48.716 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:48.717 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.718 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:48.719 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.720 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.721 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.722 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:48.723 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.724 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.725 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.726 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.729 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:48.730 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:48.731 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.732 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.733 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.734 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.735 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.735 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.735 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.735 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:48.735 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:48.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 >> v1:172.21.15.203:6812/2311533528 conn(0x7f4400040660 legacy=0x7f4400042b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f441ae08640 10 monclient: shutdown 2024-09-11T02:02:48.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f441ae08640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 >> v1:172.21.15.73:6791/0 conn(0x7f441413f350 legacy=0x7f44141d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44193a5640 1 -- 172.21.15.73:0/77499608 reap_dead start 2024-09-11T02:02:48.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.690+0000 7f44193a5640 1 -- 172.21.15.73:0/77499608 reap_dead start 2024-09-11T02:02:48.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.691+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 shutdown_connections 2024-09-11T02:02:48.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.691+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 >> 172.21.15.73:0/77499608 conn(0x7f44140a8050 msgr2=0x7f441413ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.691+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 shutdown_connections 2024-09-11T02:02:48.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.691+0000 7f441ae08640 1 -- 172.21.15.73:0/77499608 wait complete. 2024-09-11T02:02:48.737 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:48.737 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-11T02:02:48.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-11T02:02:48.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38279]: starting. 2024-09-11T02:02:48.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38279]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38277 2024-09-11T02:02:48.738 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38279]: shutting down. 2024-09-11T02:02:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.836+0000 7fab58ee2640 10 monclient: get_monmap_and_config 2024-09-11T02:02:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.836+0000 7fab58ee2640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.836+0000 7fab58ee2640 10 monclient: monmap: 2024-09-11T02:02:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:48.837386+0000 2024-09-11T02:02:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:48.837386+0000 2024-09-11T02:02:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.838 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.839 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 1 Processor -- start 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 1 -- start start 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 10 monclient: init 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 10 monclient: _add_conns ranks=[8,0,2,5,6,1,3,4,7] 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 10 monclient(hunting): picked mon.noname-e con 0x7fab54138d40 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 10 monclient(hunting): picked mon.noname-a con 0x7fab540a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 10 monclient(hunting): picked mon.noname-b con 0x7fab5413f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5409ca00 con 0x7fab540a72f0 2024-09-11T02:02:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab540a7070 con 0x7fab5413f350 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5409cee0 con 0x7fab54138d40 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab58ee2640 10 monclient(hunting): authenticate will time out at 1010.441944s 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab52d9d640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fab5413f350 0x7fab54141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38730/0 (socket says 172.21.15.73:38730) 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab52d9d640 1 -- 172.21.15.73:0/1570737805 learned_addr learned my addr 172.21.15.73:0/1570737805 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.837+0000 7fab5259c640 1 --1- 172.21.15.73:0/1570737805 >> v1:172.21.15.73:6793/0 conn(0x7fab54138d40 0x7fab54139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35428/0 (socket says 172.21.15.73:35428) 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441761391 0 0) 0x7fab540a7070 con 0x7fab5413f350 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): my global_id is 134273 2024-09-11T02:02:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab40003520 con 0x7fab5413f350 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80580066 0 0) 0x7fab5409ca00 con 0x7fab540a72f0 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): my global_id is 6066 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab540a7070 con 0x7fab540a72f0 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991552755 0 0) 0x7fab5409cee0 con 0x7fab54138d40 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient(hunting): my global_id is 115010 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab5409ca00 con 0x7fab54138d40 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3080232742 0 0) 0x7fab40003520 con 0x7fab5413f350 2024-09-11T02:02:48.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 >> v1:172.21.15.73:6793/0 conn(0x7fab54138d40 legacy=0x7fab54139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 >> v1:172.21.15.73:6789/0 conn(0x7fab540a72f0 legacy=0x7fab5413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 monclient: found mon.noname-b 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5409d1c0 con 0x7fab5413f350 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab4c001bb0 con 0x7fab5413f350 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: dump: 2024-09-11T02:02:48.851 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab58ee2640 5 monclient: authenticate success, global_id 134273 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab58ee2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab4c001dd0 con 0x7fab5413f350 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 1 -- 172.21.15.73:0/1570737805 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab4c004f60 con 0x7fab5413f350 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab58ee2640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab58ee2640 4 set_mon_vals no callback set 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.838+0000 7fab51d9b640 10 monclient: dump: 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.853 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.854 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.839+0000 7fab58ee2640 10 monclient: shutdown 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.839+0000 7fab58ee2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.839+0000 7fab58ee2640 1 -- 172.21.15.73:0/1570737805 >> v1:172.21.15.73:6790/0 conn(0x7fab5413f350 legacy=0x7fab54141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.839+0000 7fab58ee2640 1 -- 172.21.15.73:0/1570737805 shutdown_connections 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.839+0000 7fab58ee2640 1 -- 172.21.15.73:0/1570737805 >> 172.21.15.73:0/1570737805 conn(0x7fab540a8050 msgr2=0x7fab540a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.839+0000 7fab58ee2640 1 -- 172.21.15.73:0/1570737805 shutdown_connections 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.839+0000 7fab58ee2640 1 -- 172.21.15.73:0/1570737805 wait complete. 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.839+0000 7fab58ee2640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.839+0000 7fab58ee2640 10 monclient: monmap: 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 1 Processor -- start 2024-09-11T02:02:48.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 1 -- start start 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 10 monclient: init 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 10 monclient: _add_conns ranks=[3,8,6,2,0,1,5,4,7] 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 10 monclient(hunting): picked mon.noname-g con 0x7fab540a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 10 monclient(hunting): picked mon.noname-e con 0x7fab54138d40 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 10 monclient(hunting): picked mon.noname-d con 0x7fab5413f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab541427b0 con 0x7fab540a72f0 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab540a1950 con 0x7fab5413f350 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab54138730 con 0x7fab54138d40 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab58ee2640 10 monclient(hunting): authenticate will time out at 1010.444764s 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab4bfff640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fab54138d40 0x7fab5413a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35438/0 (socket says 172.21.15.73:35438) 2024-09-11T02:02:48.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab4bfff640 1 -- 172.21.15.73:0/3071967572 learned_addr learned my addr 172.21.15.73:0/3071967572 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.840+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902250681 0 0) 0x7fab54138730 con 0x7fab54138d40 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): my global_id is 115019 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab34003550 con 0x7fab54138d40 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111586749 0 0) 0x7fab540a1950 con 0x7fab5413f350 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): my global_id is 115053 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab54138730 con 0x7fab5413f350 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3118496424 0 0) 0x7fab54138730 con 0x7fab5413f350 2024-09-11T02:02:48.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab540a1950 con 0x7fab5413f350 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab4c001f80 con 0x7fab5413f350 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): dump: 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.859 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1015832433 0 0) 0x7fab34003550 con 0x7fab54138d40 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab54138730 con 0x7fab54138d40 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab3c001510 con 0x7fab54138d40 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): dump: 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.861 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738496881 0 0) 0x7fab541427b0 con 0x7fab540a72f0 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient(hunting): my global_id is 5934 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab34003550 con 0x7fab540a72f0 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 691145418 0 0) 0x7fab540a1950 con 0x7fab5413f350 2024-09-11T02:02:48.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 >> v1:172.21.15.73:6793/0 conn(0x7fab54138d40 legacy=0x7fab5413a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 >> v1:172.21.15.203:6790/0 conn(0x7fab540a72f0 legacy=0x7fab541399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient: _finish_hunting 0 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 monclient: found mon.d 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5413c0c0 con 0x7fab5413f350 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient: _finish_auth 0 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient: _check_auth_tickets 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab58ee2640 5 monclient: authenticate success, global_id 115053 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab58ee2640 10 monclient: _renew_subs 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab58ee2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fab5413c3a0 con 0x7fab5413f350 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab58ee2640 10 monclient: _renew_subs 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab58ee2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fab5413b160 con 0x7fab5413f350 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab4c005150 con 0x7fab5413f350 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab4c005640 con 0x7fab5413f350 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab5159a640 4 set_mon_vals no callback set 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.841+0000 7fab4affd640 10 monclient: dump: 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.864 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab58ee2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fab380065c0 con 0x7fab38002860 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fab4c011d80 con 0x7fab5413f350 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(217..217 src has 1..217) ==== 3506+0+0 (unknown 493866796 0 0) 0x7fab4c04e420 con 0x7fab5413f350 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1042676173 0 0) 0x7fab380065c0 con 0x7fab38002860 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab4affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab4affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab4affd640 10 monclient(hunting): my global_id is 5943 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.842+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab540a1950 con 0x7fab38002860 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4bfff640 10 monclient: get_auth_request con 0x7fab34040450 auth_method 0 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3882381507 0 0) 0x7fab540a1950 con 0x7fab38002860 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab380065c0 con 0x7fab38002860 2024-09-11T02:02:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab440018b0 con 0x7fab38002860 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 10 monclient: dump: 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 838119024 0 0) 0x7fab380065c0 con 0x7fab38002860 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.203:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab3800a160 con 0x7fab38002860 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fab44001c20 con 0x7fab38002860 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 >> v1:172.21.15.203:6790/0 conn(0x7fab38002860 legacy=0x7fab38004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.843+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 >> v1:172.21.15.203:6790/0 conn(0x7fab38002860 legacy=0x7fab38004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.849+0000 7fab58ee2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.849+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fab38009e00 con 0x7fab380090e0 2024-09-11T02:02:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252189667 0 0) 0x7fab38009e00 con 0x7fab380090e0 2024-09-11T02:02:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 10 monclient(hunting): _negotiate 2024-09-11T02:02:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 10 monclient(hunting): my global_id is 5952 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab380065c0 con 0x7fab380090e0 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3930711664 0 0) 0x7fab380065c0 con 0x7fab380090e0 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab38009e00 con 0x7fab380090e0 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab44004d50 con 0x7fab380090e0 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 10 monclient: dump: 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3756178570 0 0) 0x7fab38009e00 con 0x7fab380090e0 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 --> v1:172.21.15.203:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fab3800c3a0 con 0x7fab380090e0 2024-09-11T02:02:48.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 1267859270) 0x7fab44006280 con 0x7fab380090e0 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 >> v1:172.21.15.203:6790/0 conn(0x7fab380090e0 legacy=0x7fab38009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.850+0000 7fab4affd640 1 -- 172.21.15.73:0/3071967572 >> v1:172.21.15.203:6790/0 conn(0x7fab380090e0 legacy=0x7fab38009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:48.873 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 291288, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.874 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.875 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.876 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:48.877 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:48.878 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.880 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.881 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.882 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.883 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.884 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.885 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.886 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.887 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:48.888 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:48.889 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:48.890 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:48.891 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.892 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:48.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-09-11T02:02:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:48.894 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:48.894 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:48.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 >> v1:172.21.15.203:6812/2311533528 conn(0x7fab34040450 legacy=0x7fab34042910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab58ee2640 10 monclient: shutdown 2024-09-11T02:02:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab58ee2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 >> v1:172.21.15.73:6792/0 conn(0x7fab5413f350 legacy=0x7fab541d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab52d9d640 1 -- 172.21.15.73:0/3071967572 reap_dead start 2024-09-11T02:02:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab52d9d640 1 -- 172.21.15.73:0/3071967572 reap_dead start 2024-09-11T02:02:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 shutdown_connections 2024-09-11T02:02:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 >> 172.21.15.73:0/3071967572 conn(0x7fab540a8050 msgr2=0x7fab540a9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:48.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 shutdown_connections 2024-09-11T02:02:48.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.851+0000 7fab58ee2640 1 -- 172.21.15.73:0/3071967572 wait complete. 2024-09-11T02:02:48.897 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:48.897 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-11T02:02:48.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-11T02:02:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.995+0000 7f350bc2a640 10 monclient: get_monmap_and_config 2024-09-11T02:02:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.995+0000 7f350bc2a640 10 monclient: build_initial_monmap 2024-09-11T02:02:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.995+0000 7f350bc2a640 10 monclient: monmap: 2024-09-11T02:02:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:48.996424+0000 2024-09-11T02:02:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:48.996424+0000 2024-09-11T02:02:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:48.997 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:48.998 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 1 Processor -- start 2024-09-11T02:02:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 1 -- start start 2024-09-11T02:02:49.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 10 monclient: init 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 10 monclient: _add_conns ranks=[4,3,6,0,7,8,2,5,1] 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 10 monclient(hunting): picked mon.noname-c con 0x7f3504138d40 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 10 monclient(hunting): picked mon.noname-g con 0x7f35040a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 10 monclient(hunting): picked mon.noname-d con 0x7f350413f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350409ca00 con 0x7f35040a72f0 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35040a7070 con 0x7f3504138d40 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350409cee0 con 0x7f350413f350 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350bc2a640 10 monclient(hunting): authenticate will time out at 1010.600846s 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f35099c6640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f3504138d40 0x7f3504139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50744/0 (socket says 172.21.15.73:50744) 2024-09-11T02:02:49.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f350a1c7640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f350413f350 0x7f3504141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:40024/0 (socket says 172.21.15.73:40024) 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.996+0000 7f35099c6640 1 -- 172.21.15.73:0/647986604 learned_addr learned my addr 172.21.15.73:0/647986604 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621315458 0 0) 0x7f35040a7070 con 0x7f3504138d40 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): my global_id is 5845 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34f0003520 con 0x7f3504138d40 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3142200802 0 0) 0x7f350409cee0 con 0x7f350413f350 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): my global_id is 115062 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35040a7070 con 0x7f350413f350 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102314985 0 0) 0x7f350409ca00 con 0x7f35040a72f0 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient(hunting): my global_id is 5961 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f350409cee0 con 0x7f35040a72f0 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1964993816 0 0) 0x7f34f0003520 con 0x7f3504138d40 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 >> v1:172.21.15.73:6792/0 conn(0x7f350413f350 legacy=0x7f3504141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 >> v1:172.21.15.203:6790/0 conn(0x7f35040a72f0 legacy=0x7f350413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: _finish_hunting 0 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 monclient: found mon.noname-c 2024-09-11T02:02:49.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350409d1c0 con 0x7f3504138d40 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: _finish_auth 0 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: _check_auth_tickets 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3500001830 con 0x7f3504138d40 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: dump: 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.011 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f350bc2a640 5 monclient: authenticate success, global_id 5845 2024-09-11T02:02:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f350bc2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35000019d0 con 0x7f3504138d40 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 1 -- 172.21.15.73:0/647986604 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3500004be0 con 0x7f3504138d40 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f35089c4640 10 monclient: dump: 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f350bc2a640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.997+0000 7f350bc2a640 4 set_mon_vals no callback set 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.998+0000 7f350bc2a640 10 monclient: shutdown 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.998+0000 7f350bc2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:49.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.998+0000 7f350bc2a640 1 -- 172.21.15.73:0/647986604 >> v1:172.21.15.73:6791/0 conn(0x7f3504138d40 legacy=0x7f3504139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.998+0000 7f350bc2a640 1 -- 172.21.15.73:0/647986604 shutdown_connections 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.998+0000 7f350bc2a640 1 -- 172.21.15.73:0/647986604 >> 172.21.15.73:0/647986604 conn(0x7f35040a8050 msgr2=0x7f35040a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.998+0000 7f350bc2a640 1 -- 172.21.15.73:0/647986604 shutdown_connections 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.998+0000 7f350bc2a640 1 -- 172.21.15.73:0/647986604 wait complete. 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.998+0000 7f350bc2a640 10 monclient: build_initial_monmap 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.998+0000 7f350bc2a640 10 monclient: monmap: 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 1 Processor -- start 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 1 -- start start 2024-09-11T02:02:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 10 monclient: init 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 10 monclient: _add_conns ranks=[6,1,8,4,0,2,7,3,5] 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 10 monclient(hunting): picked mon.noname-d con 0x7f35040a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 10 monclient(hunting): picked mon.noname-f con 0x7f3504138d40 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 10 monclient(hunting): picked mon.noname-e con 0x7f350413f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350413a800 con 0x7f3504138d40 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35040a1b00 con 0x7f35040a72f0 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350413bf60 con 0x7f350413f350 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f350bc2a640 10 monclient(hunting): authenticate will time out at 1010.603651s 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f35099c6640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f35040a72f0 0x7f35041399e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:40034/0 (socket says 172.21.15.73:40034) 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f35099c6640 1 -- 172.21.15.73:0/2394467679 learned_addr learned my addr 172.21.15.73:0/2394467679 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:49.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2408757959 0 0) 0x7f35040a1b00 con 0x7f35040a72f0 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 10 monclient(hunting): my global_id is 115071 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34e8003520 con 0x7f35040a72f0 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932736157 0 0) 0x7f350413bf60 con 0x7f350413f350 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 10 monclient(hunting): my global_id is 115028 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:48.999+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35040a1b00 con 0x7f350413f350 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 565026631 0 0) 0x7f34e8003520 con 0x7f35040a72f0 2024-09-11T02:02:49.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f350413bf60 con 0x7f35040a72f0 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3500004c20 con 0x7f35040a72f0 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): dump: 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.019 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484753487 0 0) 0x7f350413a800 con 0x7f3504138d40 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): my global_id is 5725 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34e8003520 con 0x7f3504138d40 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3054090534 0 0) 0x7f35040a1b00 con 0x7f350413f350 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f350413a800 con 0x7f350413f350 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f34fc001c60 con 0x7f350413f350 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient(hunting): dump: 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.021 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.022 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1537448299 0 0) 0x7f350413bf60 con 0x7f35040a72f0 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 >> v1:172.21.15.73:6793/0 conn(0x7f350413f350 legacy=0x7f35041d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 >> v1:172.21.15.203:6789/0 conn(0x7f3504138d40 legacy=0x7f350413a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 monclient: found mon.d 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350413c240 con 0x7f35040a72f0 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient: _finish_auth 0 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f350bc2a640 5 monclient: authenticate success, global_id 115071 2024-09-11T02:02:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f350bc2a640 10 monclient: _renew_subs 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f350bc2a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f350413c520 con 0x7f35040a72f0 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f350bc2a640 10 monclient: _renew_subs 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f350bc2a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f350413b000 con 0x7f35040a72f0 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35000017a0 con 0x7f35040a72f0 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f35000019d0 con 0x7f35040a72f0 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fbfff640 4 set_mon_vals no callback set 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.000+0000 7f34fa7fc640 10 monclient: dump: 2024-09-11T02:02:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f350bc2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f34ec0065c0 con 0x7f34ec002860 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f3500011780 con 0x7f35040a72f0 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(217..217 src has 1..217) ==== 3506+0+0 (unknown 493866796 0 0) 0x7f350004e3f0 con 0x7f35040a72f0 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2277234444 0 0) 0x7f34ec0065c0 con 0x7f34ec002860 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 10 monclient(hunting): my global_id is 6089 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f350413bf60 con 0x7f34ec002860 2024-09-11T02:02:49.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f350a1c7640 10 monclient: get_auth_request con 0x7f34e8040640 auth_method 0 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2074686145 0 0) 0x7f350413bf60 con 0x7f34ec002860 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34ec0065c0 con 0x7f34ec002860 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f34f40019a0 con 0x7f34ec002860 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.001+0000 7f34fa7fc640 10 monclient: dump: 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.002+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3333077766 0 0) 0x7f34ec0065c0 con 0x7f34ec002860 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.002+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.203:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34ec00a160 con 0x7f34ec002860 2024-09-11T02:02:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.002+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f34f4004620 con 0x7f34ec002860 2024-09-11T02:02:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.002+0000 7f34fa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.002+0000 7f34fa7fc640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.002+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 >> v1:172.21.15.203:6791/0 conn(0x7f34ec002860 legacy=0x7f34ec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.002+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 >> v1:172.21.15.203:6791/0 conn(0x7f34ec002860 legacy=0x7f34ec004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.008+0000 7f350bc2a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.008+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f34ec009e00 con 0x7f34ec0090e0 2024-09-11T02:02:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986618059 0 0) 0x7f34ec009e00 con 0x7f34ec0090e0 2024-09-11T02:02:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 10 monclient(hunting): my global_id is 6098 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34ec0065c0 con 0x7f34ec0090e0 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2891580850 0 0) 0x7f34ec0065c0 con 0x7f34ec0090e0 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34ec009e00 con 0x7f34ec0090e0 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f34f4003c60 con 0x7f34ec0090e0 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 10 monclient: dump: 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.031 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2140676637 0 0) 0x7f34ec009e00 con 0x7f34ec0090e0 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 --> v1:172.21.15.203:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f34ec00c3a0 con 0x7f34ec0090e0 2024-09-11T02:02:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 511818795) 0x7f34f40047d0 con 0x7f34ec0090e0 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 >> v1:172.21.15.203:6791/0 conn(0x7f34ec0090e0 legacy=0x7f34ec009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.009+0000 7f34fa7fc640 1 -- 172.21.15.73:0/2394467679 >> v1:172.21.15.203:6791/0 conn(0x7f34ec0090e0 legacy=0x7f34ec009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:49.033 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 291446, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:02:49.034 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:49.035 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:49.036 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:49.037 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:49.038 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:49.039 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.040 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.042 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:49.043 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:49.044 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.045 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.048 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:49.049 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.050 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:49.053 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:49.054 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:02:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.055 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:49.055 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:49.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 >> v1:172.21.15.203:6812/2311533528 conn(0x7f34e8040640 legacy=0x7f34e8042b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350bc2a640 10 monclient: shutdown 2024-09-11T02:02:49.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350bc2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:49.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 >> v1:172.21.15.73:6792/0 conn(0x7f35040a72f0 legacy=0x7f35041399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350a1c7640 1 -- 172.21.15.73:0/2394467679 reap_dead start 2024-09-11T02:02:49.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350a1c7640 1 -- 172.21.15.73:0/2394467679 reap_dead start 2024-09-11T02:02:49.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 shutdown_connections 2024-09-11T02:02:49.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 >> 172.21.15.73:0/2394467679 conn(0x7f35040a8050 msgr2=0x7f350413ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:49.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 shutdown_connections 2024-09-11T02:02:49.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.010+0000 7f350bc2a640 1 -- 172.21.15.73:0/2394467679 wait complete. 2024-09-11T02:02:49.057 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:49.058 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-11T02:02:49.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-11T02:02:49.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.156+0000 7f9cf9a23640 10 monclient: get_monmap_and_config 2024-09-11T02:02:49.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.156+0000 7f9cf9a23640 10 monclient: build_initial_monmap 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.156+0000 7f9cf9a23640 10 monclient: monmap: 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:02:49.157028+0000 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:02:49.157028+0000 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:49.158 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:49.159 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.156+0000 7f9cf9a23640 1 Processor -- start 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.156+0000 7f9cf9a23640 1 -- start start 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.156+0000 7f9cf9a23640 10 monclient: init 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 10 monclient: _add_conns ranks=[4,2,0,6,5,3,7,8,1] 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 10 monclient(hunting): picked mon.noname-c con 0x7f9cf409e3a0 addr v1:172.21.15.73:6791/0 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 10 monclient(hunting): picked mon.noname-b con 0x7f9cf409ee90 addr v1:172.21.15.73:6790/0 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 10 monclient(hunting): picked mon.noname-a con 0x7f9cf413c250 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf40a13a0 con 0x7f9cf413c250 2024-09-11T02:02:49.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf409fbb0 con 0x7f9cf409ee90 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf409fe90 con 0x7f9cf409e3a0 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf9a23640 10 monclient(hunting): authenticate will time out at 1010.761523s 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf2ffd640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f9cf409e3a0 0x7f9cf409e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:50750/0 (socket says 172.21.15.73:50750) 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf2ffd640 1 -- 172.21.15.73:0/3741801552 learned_addr learned my addr 172.21.15.73:0/3741801552 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cebfff640 1 --1- 172.21.15.73:0/3741801552 >> v1:172.21.15.73:6790/0 conn(0x7f9cf409ee90 0x7f9cf413ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:38736/0 (socket says 172.21.15.73:38736) 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2506081061 0 0) 0x7f9cf409fe90 con 0x7f9cf409e3a0 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): my global_id is 5854 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ce0003520 con 0x7f9cf409e3a0 2024-09-11T02:02:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117725190 0 0) 0x7f9cf40a13a0 con 0x7f9cf413c250 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): my global_id is 6075 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf409fe90 con 0x7f9cf413c250 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3916088163 0 0) 0x7f9cf409fbb0 con 0x7f9cf409ee90 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 10 monclient(hunting): my global_id is 134282 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.157+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf40a13a0 con 0x7f9cf409ee90 2024-09-11T02:02:49.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2423300375 0 0) 0x7f9cf409fe90 con 0x7f9cf413c250 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 >> v1:172.21.15.73:6791/0 conn(0x7f9cf409e3a0 legacy=0x7f9cf409e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 >> v1:172.21.15.73:6790/0 conn(0x7f9cf409ee90 legacy=0x7f9cf413ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: _finish_hunting 0 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 1 monclient: found mon.noname-a 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf40a0170 con 0x7f9cf413c250 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: _finish_auth 0 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: _check_auth_tickets 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 5 monclient: authenticate success, global_id 6075 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9cec001ac0 con 0x7f9cf413c250 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: dump: 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.173 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9cec001ce0 con 0x7f9cf413c250 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 10 monclient: get_monmap_and_config success 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 1 -- 172.21.15.73:0/3741801552 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9cec003cd0 con 0x7f9cf413c250 2024-09-11T02:02:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 4 set_mon_vals no callback set 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf27fc640 10 monclient: dump: 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 10 monclient: shutdown 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 1 -- 172.21.15.73:0/3741801552 >> v1:172.21.15.73:6789/0 conn(0x7f9cf413c250 legacy=0x7f9cf413e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 1 -- 172.21.15.73:0/3741801552 shutdown_connections 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 1 -- 172.21.15.73:0/3741801552 >> 172.21.15.73:0/3741801552 conn(0x7f9cf40a7800 msgr2=0x7f9cf40a39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:49.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 1 -- 172.21.15.73:0/3741801552 shutdown_connections 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.158+0000 7f9cf9a23640 1 -- 172.21.15.73:0/3741801552 wait complete. 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.159+0000 7f9cf9a23640 10 monclient: build_initial_monmap 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.159+0000 7f9cf9a23640 10 monclient: monmap: 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:02:49.177 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.159+0000 7f9cf9a23640 1 Processor -- start 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.159+0000 7f9cf9a23640 1 -- start start 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.159+0000 7f9cf9a23640 10 monclient: init 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 10 monclient: _reopen_session rank -1 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 10 monclient: _add_conns ranks=[0,8,1,5,6,2,4,7,3] 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 10 monclient(hunting): picked mon.noname-a con 0x7f9cf409e3a0 addr v1:172.21.15.73:6789/0 2024-09-11T02:02:49.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 10 monclient(hunting): picked mon.noname-e con 0x7f9cf409ee90 addr v1:172.21.15.73:6793/0 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 10 monclient(hunting): picked mon.noname-f con 0x7f9cf413c250 addr v1:172.21.15.203:6789/0 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf40a6350 con 0x7f9cf409e3a0 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf4135ea0 con 0x7f9cf413c250 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf40721b0 con 0x7f9cf409ee90 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 10 monclient(hunting): _renew_subs 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf9a23640 10 monclient(hunting): authenticate will time out at 1010.764405s 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf2ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9cf409e3a0 0x7f9cf4071390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47282/0 (socket says 172.21.15.73:47282) 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf2ffd640 1 -- 172.21.15.73:0/2623304856 learned_addr learned my addr 172.21.15.73:0/2623304856 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622004052 0 0) 0x7f9cf40721b0 con 0x7f9cf409ee90 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): my global_id is 115037 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd4003520 con 0x7f9cf409ee90 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895311462 0 0) 0x7f9ce4001ab0 con 0x7f9cf409e3a0 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): my global_id is 6084 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf40721b0 con 0x7f9cf409e3a0 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1598153350 0 0) 0x7f9cd4003520 con 0x7f9cf409ee90 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ce4001ab0 con 0x7f9cf409ee90 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 247755977 0 0) 0x7f9cf40721b0 con 0x7f9cf409e3a0 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cd4003520 con 0x7f9cf409e3a0 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9cdc001370 con 0x7f9cf409ee90 2024-09-11T02:02:49.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): dump: 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.181 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582865551 0 0) 0x7f9cf4135ea0 con 0x7f9cf413c250 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): my global_id is 5734 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cf40721b0 con 0x7f9cf413c250 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9ce4001830 con 0x7f9cf409e3a0 2024-09-11T02:02:49.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.160+0000 7f9cf0ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 10 monclient(hunting): dump: 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.183 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2394530227 0 0) 0x7f9ce4001ab0 con 0x7f9cf409ee90 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 >> v1:172.21.15.203:6789/0 conn(0x7f9cf413c250 legacy=0x7f9cf41d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 >> v1:172.21.15.73:6789/0 conn(0x7f9cf409e3a0 legacy=0x7f9cf4071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 1 monclient: found mon.e 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:02:49.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf40a5e90 con 0x7f9cf409ee90 2024-09-11T02:02:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 10 monclient: _finish_auth 0 2024-09-11T02:02:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:02:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:02:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf9a23640 5 monclient: authenticate success, global_id 115037 2024-09-11T02:02:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf9a23640 10 monclient: _renew_subs 2024-09-11T02:02:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf9a23640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf4072e50 con 0x7f9cf409ee90 2024-09-11T02:02:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf9a23640 10 monclient: _renew_subs 2024-09-11T02:02:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf9a23640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:02:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f9cf413b740 con 0x7f9cf409ee90 2024-09-11T02:02:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9cdc0016d0 con 0x7f9cf409ee90 2024-09-11T02:02:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:02:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9cdc004dd0 con 0x7f9cf409ee90 2024-09-11T02:02:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf1ffb640 4 set_mon_vals no callback set 2024-09-11T02:02:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:02:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf0ff9640 10 monclient: dump: 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.187 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf9a23640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.161+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9cd80065c0 con 0x7f9cd8002860 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9cdc011510 con 0x7f9cf409ee90 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(217..217 src has 1..217) ==== 3506+0+0 (unknown 493866796 0 0) 0x7f9cdc04e300 con 0x7f9cf409ee90 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf37fe640 10 monclient: get_auth_request con 0x7f9cd4042680 auth_method 0 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459499091 0 0) 0x7f9cd80065c0 con 0x7f9cd8002860 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 10 monclient(hunting): my global_id is 5875 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ce4001ab0 con 0x7f9cd8002860 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2193590368 0 0) 0x7f9ce4001ab0 con 0x7f9cd8002860 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cd80065c0 con 0x7f9cd8002860 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9ce4004fc0 con 0x7f9cd8002860 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.162+0000 7f9cf0ff9640 10 monclient: dump: 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.189 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.163+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2025738059 0 0) 0x7f9cd80065c0 con 0x7f9cd8002860 2024-09-11T02:02:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.163+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.203:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cd800a160 con 0x7f9cd8002860 2024-09-11T02:02:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.163+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9ce40064a0 con 0x7f9cd8002860 2024-09-11T02:02:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.163+0000 7f9cf0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:02:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.163+0000 7f9cf0ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:02:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.163+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 >> v1:172.21.15.203:6792/0 conn(0x7f9cd8002860 legacy=0x7f9cd8004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.163+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 >> v1:172.21.15.203:6792/0 conn(0x7f9cd8002860 legacy=0x7f9cd8004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.169+0000 7f9cf9a23640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.169+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9cd8009e20 con 0x7f9cd80090e0 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768035304 0 0) 0x7f9cd8009e20 con 0x7f9cd80090e0 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 10 monclient(hunting): my global_id is 5884 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd80065c0 con 0x7f9cd80090e0 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1854199990 0 0) 0x7f9cd80065c0 con 0x7f9cd80090e0 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9cd8009e20 con 0x7f9cd80090e0 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9ce4005630 con 0x7f9cd80090e0 2024-09-11T02:02:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 10 monclient: dump: 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:02:49.194 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:02:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:02:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:02:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:02:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:02:49.195 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:02:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 364553382 0 0) 0x7f9cd8009e20 con 0x7f9cd80090e0 2024-09-11T02:02:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 --> v1:172.21.15.203:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9cd800c3f0 con 0x7f9cd80090e0 2024-09-11T02:02:49.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 2848325272) 0x7f9ce4005920 con 0x7f9cd80090e0 2024-09-11T02:02:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:02:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:02:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 >> v1:172.21.15.203:6792/0 conn(0x7f9cd80090e0 legacy=0x7f9cd8009570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.170+0000 7f9cf0ff9640 1 -- 172.21.15.73:0/2623304856 >> v1:172.21.15.203:6792/0 conn(0x7f9cd80090e0 legacy=0x7f9cd8009570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:02:49.197 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:02:49.197 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:49.197 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:49.197 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:02:49.197 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 40, 2024-09-11T02:02:49.198 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 291591, 2024-09-11T02:02:49.198 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:02:49.198 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:02:49.198 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:02:49.198 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:02:49.198 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:02:49.199 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:02:49.199 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:02:49.199 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:02:49.199 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:02:49.199 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:02:49.199 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:49.199 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-09-11T02:02:49.200 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:49.200 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:02:49.200 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:02:49.200 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:49.200 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:49.200 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:49.201 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:49.201 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:49.201 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:49.202 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:49.202 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:49.202 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:49.202 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:49.202 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:49.203 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:49.203 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:02:49.203 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:02:49.203 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:49.203 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:49.204 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:49.204 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:49.204 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:49.204 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:49.204 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:49.204 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:49.205 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:49.205 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:49.205 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:49.205 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.206 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:02:49.206 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:02:49.206 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:02:49.206 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:02:49.207 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:02:49.207 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:02:49.207 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:49.207 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:02:49.207 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:02:49.207 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:02:49.208 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:02:49.208 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:02:49.208 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:02:49.208 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:02:49.208 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:02:49.209 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:02:49.209 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:02:49.209 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:02:49.209 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:02:49.209 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:02:49.209 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:02:49.210 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:02:49.210 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:02:49.210 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:02:49.210 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:02:49.210 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:02:49.210 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:02:49.211 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:02:49.211 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:49.211 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:02:49.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.211 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:02:49.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.211 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:02:49.212 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:02:49.212 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.212 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.212 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.212 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:02:49.213 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.213 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.213 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.213 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:02:49.213 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:02:49.214 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.214 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.214 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.214 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:02:49.214 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:02:49.215 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:02:49.215 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.215 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.216 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:02:49.216 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:02:49.216 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.216 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.217 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.217 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:02:49.217 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:02:49.217 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.217 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.218 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.218 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:02:49.218 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.218 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.218 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.219 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:02:49.219 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:02:49.219 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.219 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.219 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.219 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.219 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:02:49.220 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:02:49.220 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.220 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.220 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.220 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:02:49.221 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.221 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.221 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:02:49.221 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:02:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.222 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.223 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.224 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:02:49.225 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.226 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:02:49.227 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:02:49.228 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.229 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:02:49.230 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:02:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:02:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:02:49.231 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:02:49.231 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:02:49.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9cd4042680 legacy=0x7f9cd4044b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf9a23640 10 monclient: shutdown 2024-09-11T02:02:49.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf9a23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:02:49.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 >> v1:172.21.15.73:6793/0 conn(0x7f9cf409ee90 legacy=0x7f9cf4071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:02:49.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf37fe640 1 -- 172.21.15.73:0/2623304856 reap_dead start 2024-09-11T02:02:49.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf37fe640 1 -- 172.21.15.73:0/2623304856 reap_dead start 2024-09-11T02:02:49.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 shutdown_connections 2024-09-11T02:02:49.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 >> 172.21.15.73:0/2623304856 conn(0x7f9cf40a7800 msgr2=0x7f9cf40a4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:02:49.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 shutdown_connections 2024-09-11T02:02:49.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:02:49.171+0000 7f9cf9a23640 1 -- 172.21.15.73:0/2623304856 wait complete. 2024-09-11T02:02:49.233 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:02:49.234 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['f', 'h'] 2024-09-11T02:02:49.234 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-09-11T02:02:49.234 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-09-11T02:02:49.234 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-09-11T02:02:49.234 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-09-11T02:02:49.234 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:02:49.251 INFO:tasks.ceph.mon.f:Stopped 2024-09-11T02:02:49.251 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2024-09-11T02:02:49.251 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2024-09-11T02:02:49.251 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-09-11T02:02:49.251 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:02:49.306 INFO:tasks.ceph.mon.h:Stopped 2024-09-11T02:02:49.306 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-11T02:02:49.306 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-11T02:02:49.306 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T02:03:04.307 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-11T02:03:04.308 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-11T02:03:04.308 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-09-11T02:03:04.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:03:04.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.416+0000 7f9b4cffb640 10 monclient: get_monmap_and_config 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.416+0000 7f9b4cffb640 10 monclient: build_initial_monmap 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.416+0000 7f9b4cffb640 10 monclient: monmap: 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:03:04.417257+0000 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:03:04.417257+0000 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:04.418 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:04.419 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:04.419 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:04.419 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:04.419 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:04.419 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:04.419 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:04.419 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:04.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 1 Processor -- start 2024-09-11T02:03:04.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 1 -- start start 2024-09-11T02:03:04.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 10 monclient: init 2024-09-11T02:03:04.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 10 monclient: _add_conns ranks=[4,6,7,3,1,2,5,8,0] 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 10 monclient(hunting): picked mon.noname-c con 0x7f9b48135ac0 addr v1:172.21.15.73:6791/0 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 10 monclient(hunting): picked mon.noname-d con 0x7f9b4809dcc0 addr v1:172.21.15.73:6792/0 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 10 monclient(hunting): picked mon.noname-i con 0x7f9b4813f250 addr v1:172.21.15.203:6792/0 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4809d2e0 con 0x7f9b48135ac0 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4809d5c0 con 0x7f9b4809dcc0 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4809d8a0 con 0x7f9b4813f250 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4cffb640 10 monclient(hunting): authenticate will time out at 1026.021758s 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b3ffff640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f9b4809dcc0 0x7f9b4813db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:54446/0 (socket says 172.21.15.73:54446) 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b3ffff640 1 -- 172.21.15.73:0/3748652733 learned_addr learned my addr 172.21.15.73:0/3748652733 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:04.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:04.417+0000 7f9b4659c640 1 --1- 172.21.15.73:0/3748652733 >> v1:172.21.15.73:6791/0 conn(0x7f9b48135ac0 0x7f9b48135ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:39198/0 (socket says 172.21.15.73:39198) 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 10 monclient(hunting): tick 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 10 monclient(hunting): _check_auth_tickets 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 1 monclient(hunting): continuing hunt 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 10 monclient(hunting): _reopen_session rank -1 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.203:6792/0 conn(0x7f9b4813f250 legacy=0x7f9b48141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.73:6792/0 conn(0x7f9b4809dcc0 legacy=0x7f9b4813db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.73:6791/0 conn(0x7f9b48135ac0 legacy=0x7f9b48135ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 10 monclient: _add_conns ranks=[1,5,8,0,3,2] 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 10 monclient(hunting): picked mon.noname-f con 0x7f9b280037e0 addr v1:172.21.15.203:6789/0 2024-09-11T02:03:07.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 10 monclient(hunting): picked mon.noname-h con 0x7f9b280073d0 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 10 monclient(hunting): picked mon.noname-e con 0x7f9b2800b100 addr v1:172.21.15.73:6793/0 2024-09-11T02:03:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 1 -- 172.21.15.73:0/3748652733 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b480a5390 con 0x7f9b280037e0 2024-09-11T02:03:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 1 -- 172.21.15.73:0/3748652733 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2800ffd0 con 0x7f9b280073d0 2024-09-11T02:03:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 1 -- 172.21.15.73:0/3748652733 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b28011270 con 0x7f9b2800b100 2024-09-11T02:03:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b44d99640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b4659c640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.203:6789/0 conn(0x7f9b280037e0 legacy=0x7f9b28005c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6789/0 2024-09-11T02:03:07.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.418+0000 7f9b3ffff640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.203:6791/0 conn(0x7f9b280073d0 legacy=0x7f9b28009850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:07.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.619+0000 7f9b4659c640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.203:6789/0 conn(0x7f9b280037e0 legacy=0x7f9b28005c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6789/0 2024-09-11T02:03:07.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:07.619+0000 7f9b3ffff640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.203:6791/0 conn(0x7f9b280073d0 legacy=0x7f9b28009850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:08.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.020+0000 7f9b4659c640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.203:6789/0 conn(0x7f9b280037e0 legacy=0x7f9b28005c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6789/0 2024-09-11T02:03:08.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.020+0000 7f9b3ffff640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.203:6791/0 conn(0x7f9b280073d0 legacy=0x7f9b28009850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:08.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 -- 172.21.15.73:0/3748652733 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 488456405 0 0) 0x7f9b28011270 con 0x7f9b2800b100 2024-09-11T02:03:08.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:03:08.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:08.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient(hunting): my global_id is 115046 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 -- 172.21.15.73:0/3748652733 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b34003520 con 0x7f9b2800b100 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 -- 172.21.15.73:0/3748652733 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2876906786 0 0) 0x7f9b34003520 con 0x7f9b2800b100 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.203:6791/0 conn(0x7f9b280073d0 legacy=0x7f9b28009850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.203:6789/0 conn(0x7f9b280037e0 legacy=0x7f9b28005c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: _finish_hunting 0 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 monclient: found mon.noname-e 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b46d9d640 1 -- 172.21.15.73:0/3748652733 reap_dead start 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 -- 172.21.15.73:0/3748652733 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b28012510 con 0x7f9b2800b100 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: _finish_auth 0 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: _check_auth_tickets 2024-09-11T02:03:08.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 -- 172.21.15.73:0/3748652733 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9b40001bb0 con 0x7f9b2800b100 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: dump: 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b4cffb640 5 monclient: authenticate success, global_id 115046 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b4cffb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:08.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 -- 172.21.15.73:0/3748652733 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b40001df0 con 0x7f9b2800b100 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 1 -- 172.21.15.73:0/3748652733 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9b40003cd0 con 0x7f9b2800b100 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b4cffb640 10 monclient: get_monmap_and_config success 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b4cffb640 4 set_mon_vals no callback set 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.762+0000 7f9b45d9b640 10 monclient: dump: 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:08.769 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.763+0000 7f9b4cffb640 10 monclient: shutdown 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.763+0000 7f9b4cffb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.763+0000 7f9b4cffb640 1 -- 172.21.15.73:0/3748652733 >> v1:172.21.15.73:6793/0 conn(0x7f9b2800b100 legacy=0x7f9b2800d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.763+0000 7f9b4cffb640 1 -- 172.21.15.73:0/3748652733 shutdown_connections 2024-09-11T02:03:08.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.763+0000 7f9b4cffb640 1 -- 172.21.15.73:0/3748652733 >> 172.21.15.73:0/3748652733 conn(0x7f9b480a84e0 msgr2=0x7f9b480a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:08.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.763+0000 7f9b4cffb640 1 -- 172.21.15.73:0/3748652733 shutdown_connections 2024-09-11T02:03:08.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.763+0000 7f9b4cffb640 1 -- 172.21.15.73:0/3748652733 wait complete. 2024-09-11T02:03:08.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.764+0000 7f9b4cffb640 10 monclient: build_initial_monmap 2024-09-11T02:03:08.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.764+0000 7f9b4cffb640 10 monclient: monmap: 2024-09-11T02:03:08.772 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:08.773 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.765+0000 7f9b4cffb640 1 Processor -- start 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.765+0000 7f9b4cffb640 1 -- start start 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.765+0000 7f9b4cffb640 10 monclient: init 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.765+0000 7f9b4cffb640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.765+0000 7f9b4cffb640 10 monclient: _add_conns ranks=[5,7,3,8,6,2,0,4,1] 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.765+0000 7f9b4cffb640 10 monclient(hunting): picked mon.noname-h con 0x7f9b2800b100 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b4cffb640 10 monclient(hunting): picked mon.noname-i con 0x7f9b4813d8c0 addr v1:172.21.15.203:6792/0 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b4cffb640 10 monclient(hunting): picked mon.noname-g con 0x7f9b481d3800 addr v1:172.21.15.203:6790/0 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b4cffb640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4813e240 con 0x7f9b481d3800 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b4cffb640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4813dd30 con 0x7f9b2800b100 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b4cffb640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4813e930 con 0x7f9b4813d8c0 2024-09-11T02:03:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b4cffb640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:08.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b4659c640 1 -- >> v1:172.21.15.203:6791/0 conn(0x7f9b2800b100 legacy=0x7f9b481cd4b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:08.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b4cffb640 10 monclient(hunting): authenticate will time out at 1030.370140s 2024-09-11T02:03:08.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b46d9d640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7f9b481d3800 0x7f9b481d5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.73:38372/0 (socket says 172.21.15.73:38372) 2024-09-11T02:03:08.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b46d9d640 1 -- 172.21.15.73:0/1774937350 learned_addr learned my addr 172.21.15.73:0/1774937350 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:08.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.766+0000 7f9b3ffff640 1 --1- >> v1:172.21.15.203:6792/0 conn(0x7f9b4813d8c0 0x7f9b48134820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.203:6792/0 says I am v1:172.21.15.73:50602/0 (socket says 172.21.15.73:50602) 2024-09-11T02:03:08.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045215692 0 0) 0x7f9b4813e240 con 0x7f9b481d3800 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): my global_id is 5970 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b28010580 con 0x7f9b481d3800 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451362584 0 0) 0x7f9b4813e930 con 0x7f9b4813d8c0 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): my global_id is 5893 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b4813e240 con 0x7f9b4813d8c0 2024-09-11T02:03:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2981249668 0 0) 0x7f9b4813e240 con 0x7f9b4813d8c0 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b4813e930 con 0x7f9b4813d8c0 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 855662497 0 0) 0x7f9b28010580 con 0x7f9b481d3800 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b4813e240 con 0x7f9b481d3800 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9b30001930 con 0x7f9b4813d8c0 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): dump: 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9b40003cb0 con 0x7f9b481d3800 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:03:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 10 monclient(hunting): dump: 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.774+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2951384795 0 0) 0x7f9b4813e930 con 0x7f9b4813d8c0 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 >> v1:172.21.15.203:6791/0 conn(0x7f9b2800b100 legacy=0x7f9b481cd4b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 >> v1:172.21.15.203:6790/0 conn(0x7f9b481d3800 legacy=0x7f9b481d5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 10 monclient: _finish_hunting 0 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 1 monclient: found mon.i 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 --> v1:172.21.15.203:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4811f920 con 0x7f9b4813d8c0 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 10 monclient: _finish_auth 0 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 10 monclient: _check_auth_tickets 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b4cffb640 5 monclient: authenticate success, global_id 5893 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b4cffb640 10 monclient: _renew_subs 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b4cffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 --> v1:172.21.15.203:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4811fc00 con 0x7f9b4813d8c0 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b4cffb640 10 monclient: _renew_subs 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b4cffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 --> v1:172.21.15.203:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b481d7310 con 0x7f9b4813d8c0 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b300047e0 con 0x7f9b4813d8c0 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9b30004d50 con 0x7f9b4813d8c0 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 10 monclient: dump: 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:08.785 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b4559a640 4 set_mon_vals no callback set 2024-09-11T02:03:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.775+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9b30004ef0 con 0x7f9b4813d8c0 2024-09-11T02:03:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.776+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 8 ==== osd_map(217..217 src has 1..217) ==== 3506+0+0 (unknown 493866796 0 0) 0x7f9b3004e030 con 0x7f9b4813d8c0 2024-09-11T02:03:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.776+0000 7f9b4659c640 10 monclient: get_auth_request con 0x7f9b280414c0 auth_method 0 2024-09-11T02:03:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.776+0000 7f9b4cffb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.776+0000 7f9b4cffb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.776+0000 7f9b4cffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T02:03:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.776+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 --> v1:172.21.15.203:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2c005080 con 0x7f9b4813d8c0 2024-09-11T02:03:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.781+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f9b30017250 con 0x7f9b4813d8c0 2024-09-11T02:03:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.781+0000 7f9b3effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:08.781+0000 7f9b3effd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:03:09.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.042+0000 7f9b4cffb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:03:09.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.042+0000 7f9b4cffb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:03:09.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.042+0000 7f9b4cffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.203:6792/0 2024-09-11T02:03:09.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.042+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 --> v1:172.21.15.203:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9b2c005370 con 0x7f9b4813d8c0 2024-09-11T02:03:09.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.043+0000 7f9b3effd640 1 -- 172.21.15.73:0/1774937350 <== mon.7 v1:172.21.15.203:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2711 (unknown 254746657 0 3752890355) 0x7f9b3001b630 con 0x7f9b4813d8c0 2024-09-11T02:03:09.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.043+0000 7f9b3effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:03:09.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.043+0000 7f9b3effd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:03:09.044 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":44,"quorum":[0,3,4,6,7,8],"quorum_names":["a","g","c","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:03:09.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.044+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9b280414c0 legacy=0x7f9b28043980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:09.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.044+0000 7f9b4cffb640 10 monclient: shutdown 2024-09-11T02:03:09.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.044+0000 7f9b4cffb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:09.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.044+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 >> v1:172.21.15.203:6792/0 conn(0x7f9b4813d8c0 legacy=0x7f9b48134820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:09.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.045+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 shutdown_connections 2024-09-11T02:03:09.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.045+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 >> 172.21.15.73:0/1774937350 conn(0x7f9b480a84e0 msgr2=0x7f9b480a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:09.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.045+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 shutdown_connections 2024-09-11T02:03:09.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:09.045+0000 7f9b4cffb640 1 -- 172.21.15.73:0/1774937350 wait complete. 2024-09-11T02:03:12.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:03:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.165+0000 7fa7068fe640 10 monclient: get_monmap_and_config 2024-09-11T02:03:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.165+0000 7fa7068fe640 10 monclient: build_initial_monmap 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.165+0000 7fa7068fe640 10 monclient: monmap: 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:03:12.165938+0000 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:03:12.165938+0000 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:12.168 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.165+0000 7fa7068fe640 1 Processor -- start 2024-09-11T02:03:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.165+0000 7fa7068fe640 1 -- start start 2024-09-11T02:03:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.165+0000 7fa7068fe640 10 monclient: init 2024-09-11T02:03:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 10 monclient: _add_conns ranks=[7,1,4,3,5,2,8,0,6] 2024-09-11T02:03:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 10 monclient(hunting): picked mon.noname-i con 0x7fa7000a5b30 addr v1:172.21.15.203:6792/0 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 10 monclient(hunting): picked mon.noname-f con 0x7fa7000a6620 addr v1:172.21.15.203:6789/0 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 10 monclient(hunting): picked mon.noname-c con 0x7fa70009db70 addr v1:172.21.15.73:6791/0 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7000a7490 con 0x7fa7000a6620 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa70009ca00 con 0x7fa70009db70 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa70006fbf0 con 0x7fa7000a5b30 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa7068fe640 10 monclient(hunting): authenticate will time out at 1033.770461s 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa6ff7fe640 1 -- >> v1:172.21.15.203:6789/0 conn(0x7fa7000a6620 legacy=0x7fa70013dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6789/0 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa704e9b640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fa70009db70 0x7fa700141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51720/0 (socket says 172.21.15.73:51720) 2024-09-11T02:03:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.166+0000 7fa704e9b640 1 -- 172.21.15.73:0/974659598 learned_addr learned my addr 172.21.15.73:0/974659598 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:12.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.367+0000 7fa6ff7fe640 1 -- 172.21.15.73:0/974659598 >> v1:172.21.15.203:6789/0 conn(0x7fa7000a6620 legacy=0x7fa70013dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6789/0 2024-09-11T02:03:12.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:12.768+0000 7fa6ff7fe640 1 -- 172.21.15.73:0/974659598 >> v1:172.21.15.203:6789/0 conn(0x7fa7000a6620 legacy=0x7fa70013dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6789/0 2024-09-11T02:03:13.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:13.569+0000 7fa6ff7fe640 1 -- 172.21.15.73:0/974659598 >> v1:172.21.15.203:6789/0 conn(0x7fa7000a6620 legacy=0x7fa70013dd40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6789/0 2024-09-11T02:03:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.324+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581524432 0 0) 0x7fa70006fbf0 con 0x7fa7000a5b30 2024-09-11T02:03:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.324+0000 7fa6feffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.324+0000 7fa6feffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.324+0000 7fa6feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.324+0000 7fa6feffd640 10 monclient(hunting): my global_id is 5902 2024-09-11T02:03:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.324+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e8003520 con 0x7fa7000a5b30 2024-09-11T02:03:14.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157336615 0 0) 0x7fa70009ca00 con 0x7fa70009db70 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient(hunting): my global_id is 5863 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa70006fbf0 con 0x7fa70009db70 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2013738681 0 0) 0x7fa6e8003520 con 0x7fa7000a5b30 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 >> v1:172.21.15.73:6791/0 conn(0x7fa70009db70 legacy=0x7fa700141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 >> v1:172.21.15.203:6789/0 conn(0x7fa7000a6620 legacy=0x7fa70013dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient: _finish_hunting 0 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 1 monclient: found mon.noname-i 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.203:6792/0 2024-09-11T02:03:14.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 --> v1:172.21.15.203:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa70009ceb0 con 0x7fa7000a5b30 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient: _finish_auth 0 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient: _check_auth_tickets 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa7068fe640 5 monclient: authenticate success, global_id 5902 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa7068fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa6f00017d0 con 0x7fa7000a5b30 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa6feffd640 10 monclient: dump: 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.329 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.330 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.331 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.325+0000 7fa7068fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.326+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 <== mon.7 v1:172.21.15.203:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6f0001970 con 0x7fa7000a5b30 2024-09-11T02:03:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.326+0000 7fa6feffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.326+0000 7fa6feffd640 1 -- 172.21.15.73:0/974659598 <== mon.7 v1:172.21.15.203:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa6f00017d0 con 0x7fa7000a5b30 2024-09-11T02:03:14.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.326+0000 7fa6feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.326+0000 7fa6feffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.326+0000 7fa6feffd640 10 monclient: dump: 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.334 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.335 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.326+0000 7fa7068fe640 10 monclient: get_monmap_and_config success 2024-09-11T02:03:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.326+0000 7fa7068fe640 4 set_mon_vals no callback set 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.327+0000 7fa7068fe640 10 monclient: shutdown 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.327+0000 7fa7068fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.327+0000 7fa7068fe640 1 -- 172.21.15.73:0/974659598 >> v1:172.21.15.203:6792/0 conn(0x7fa7000a5b30 legacy=0x7fa7000a5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.327+0000 7fa7068fe640 1 -- 172.21.15.73:0/974659598 shutdown_connections 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.327+0000 7fa7068fe640 1 -- 172.21.15.73:0/974659598 >> 172.21.15.73:0/974659598 conn(0x7fa7000abe30 msgr2=0x7fa7000a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.327+0000 7fa7068fe640 1 -- 172.21.15.73:0/974659598 shutdown_connections 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.328+0000 7fa7068fe640 1 -- 172.21.15.73:0/974659598 wait complete. 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.328+0000 7fa7068fe640 10 monclient: build_initial_monmap 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.328+0000 7fa7068fe640 10 monclient: monmap: 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:03:14.336 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.329+0000 7fa7068fe640 1 Processor -- start 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.329+0000 7fa7068fe640 1 -- start start 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.329+0000 7fa7068fe640 10 monclient: init 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.330+0000 7fa7068fe640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.330+0000 7fa7068fe640 10 monclient: _add_conns ranks=[0,2,5,6,7,1,8,3,4] 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.330+0000 7fa6fffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa7000a5b30 0x7fa700125260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33110/0 (socket says 172.21.15.73:33110) 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.330+0000 7fa7068fe640 10 monclient(hunting): picked mon.noname-a con 0x7fa7000a5b30 addr v1:172.21.15.73:6789/0 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.330+0000 7fa6fffff640 1 -- 172.21.15.73:0/141864756 learned_addr learned my addr 172.21.15.73:0/141864756 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.330+0000 7fa7068fe640 10 monclient(hunting): picked mon.noname-b con 0x7fa7000a6620 addr v1:172.21.15.73:6790/0 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.331+0000 7fa7068fe640 10 monclient(hunting): picked mon.noname-h con 0x7fa7001d3ac0 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.331+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7001281a0 con 0x7fa7000a5b30 2024-09-11T02:03:14.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.331+0000 7fa704e9b640 1 -- 172.21.15.73:0/141864756 >> v1:172.21.15.203:6791/0 conn(0x7fa7001d3ac0 legacy=0x7fa7001d5eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:14.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.331+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa700129010 con 0x7fa7000a6620 2024-09-11T02:03:14.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.331+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa70006ea10 con 0x7fa7001d3ac0 2024-09-11T02:03:14.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.331+0000 7fa7068fe640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:14.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.331+0000 7fa7068fe640 10 monclient(hunting): authenticate will time out at 1035.935397s 2024-09-11T02:03:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.332+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1568710246 0 0) 0x7fa7001281a0 con 0x7fa7000a5b30 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.332+0000 7fa6fcff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.332+0000 7fa6fcff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.332+0000 7fa6fcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.332+0000 7fa6fcff9640 10 monclient(hunting): my global_id is 6093 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.332+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6ec003550 con 0x7fa7000a5b30 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2013395126 0 0) 0x7fa6ec003550 con 0x7fa7000a5b30 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7001281a0 con 0x7fa7000a5b30 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa6f0003930 con 0x7fa7000a5b30 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient(hunting): dump: 2024-09-11T02:03:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.343 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 412414978 0 0) 0x7fa7001281a0 con 0x7fa7000a5b30 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 >> v1:172.21.15.203:6791/0 conn(0x7fa7001d3ac0 legacy=0x7fa7001d5eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 >> v1:172.21.15.73:6790/0 conn(0x7fa7000a6620 legacy=0x7fa700125970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient: _finish_hunting 0 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 monclient: found mon.a 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa700126cb0 con 0x7fa7000a5b30 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient: _finish_auth 0 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient: _check_auth_tickets 2024-09-11T02:03:14.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa7068fe640 5 monclient: authenticate success, global_id 6093 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa7068fe640 10 monclient: _renew_subs 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa7068fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa700126080 con 0x7fa7000a5b30 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa7068fe640 10 monclient: _renew_subs 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa7068fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa700127ab0 con 0x7fa7000a5b30 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6f0001d00 con 0x7fa7000a5b30 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fe7fc640 4 set_mon_vals no callback set 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa6f0004140 con 0x7fa7000a5b30 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.333+0000 7fa6fcff9640 10 monclient: dump: 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.335+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fa6f00042e0 con 0x7fa7000a5b30 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.335+0000 7fa7068fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.335+0000 7fa7068fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.335+0000 7fa7068fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.335+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6e0005080 con 0x7fa7000a5b30 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.335+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(218..218 src has 1..218) ==== 3898+0+0 (unknown 2473122303 0 0) 0x7fa6f004e560 con 0x7fa7000a5b30 2024-09-11T02:03:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.335+0000 7fa6ff7fe640 10 monclient: get_auth_request con 0x7fa6ec03fc70 auth_method 0 2024-09-11T02:03:14.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.341+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fa6f0017780 con 0x7fa7000a5b30 2024-09-11T02:03:14.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.341+0000 7fa6fcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:14.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.341+0000 7fa6fcff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:03:14.466 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:14.466 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38314]: starting. 2024-09-11T02:03:14.466 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38314]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38277 2024-09-11T02:03:14.466 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38314]: created object 0... 2024-09-11T02:03:14.466 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38314]: created object 25... 2024-09-11T02:03:14.466 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38314]: created object 49... 2024-09-11T02:03:14.466 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38314]: finishing. 2024-09-11T02:03:14.466 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38314]: shutting down. 2024-09-11T02:03:14.476 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:14.476 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38316]: starting. 2024-09-11T02:03:14.477 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38316]: listing objects. 2024-09-11T02:03:14.477 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38316]: listed object 0... 2024-09-11T02:03:14.477 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38316]: listed object 25... 2024-09-11T02:03:14.477 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38316]: saw 50 objects 2024-09-11T02:03:14.477 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38316]: shutting down. 2024-09-11T02:03:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.614+0000 7fa7068fe640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:03:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.614+0000 7fa7068fe640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:03:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.614+0000 7fa7068fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:03:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.614+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa6e0005370 con 0x7fa7000a5b30 2024-09-11T02:03:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.614+0000 7fa6fcff9640 1 -- 172.21.15.73:0/141864756 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2717 (unknown 254746657 0 1893529331) 0x7fa6f0017080 con 0x7fa7000a5b30 2024-09-11T02:03:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.614+0000 7fa6fcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:03:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.614+0000 7fa6fcff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:03:14.617 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":46,"quorum":[0,2,3,4,6,7,8],"quorum_names":["a","b","g","c","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:03:14.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.616+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 >> v1:172.21.15.203:6812/2311533528 conn(0x7fa6ec03fc70 legacy=0x7fa6ec042130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.616+0000 7fa7068fe640 10 monclient: shutdown 2024-09-11T02:03:14.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.616+0000 7fa7068fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:14.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.616+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 >> v1:172.21.15.73:6789/0 conn(0x7fa7000a5b30 legacy=0x7fa700125260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.616+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 shutdown_connections 2024-09-11T02:03:14.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.616+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 >> 172.21.15.73:0/141864756 conn(0x7fa70009db70 msgr2=0x7fa7000a1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:14.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.616+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 shutdown_connections 2024-09-11T02:03:14.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.616+0000 7fa7068fe640 1 -- 172.21.15.73:0/141864756 wait complete. 2024-09-11T02:03:14.628 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-09-11T02:03:14.628 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon a 2024-09-11T02:03:14.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T02:03:14.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.725+0000 7fe81a218640 10 monclient: get_monmap_and_config 2024-09-11T02:03:14.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.725+0000 7fe81a218640 10 monclient: build_initial_monmap 2024-09-11T02:03:14.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.725+0000 7fe81a218640 10 monclient: monmap: 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:03:14.726636+0000 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:03:14.726636+0000 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:14.728 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:14.729 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:14.729 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:14.729 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:14.729 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:14.729 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.726+0000 7fe81a218640 1 Processor -- start 2024-09-11T02:03:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.726+0000 7fe81a218640 1 -- start start 2024-09-11T02:03:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.726+0000 7fe81a218640 10 monclient: init 2024-09-11T02:03:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.726+0000 7fe81a218640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.726+0000 7fe81a218640 10 monclient: _add_conns ranks=[5,3,4,2,6,8,1,7,0] 2024-09-11T02:03:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 10 monclient(hunting): picked mon.noname-h con 0x7fe814138e40 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 10 monclient(hunting): picked mon.noname-g con 0x7fe814139220 addr v1:172.21.15.203:6790/0 2024-09-11T02:03:14.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 10 monclient(hunting): picked mon.noname-c con 0x7fe81413f250 addr v1:172.21.15.73:6791/0 2024-09-11T02:03:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81409d190 con 0x7fe814139220 2024-09-11T02:03:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81409e280 con 0x7fe81413f250 2024-09-11T02:03:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81409ceb0 con 0x7fe814138e40 2024-09-11T02:03:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 10 monclient(hunting): authenticate will time out at 1036.331074s 2024-09-11T02:03:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe813fff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fe81413f250 0x7fe814141640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51728/0 (socket says 172.21.15.73:51728) 2024-09-11T02:03:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe813fff640 1 -- 172.21.15.73:0/3700769311 learned_addr learned my addr 172.21.15.73:0/3700769311 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:14.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8137fe640 1 -- 172.21.15.73:0/3700769311 >> v1:172.21.15.203:6791/0 conn(0x7fe814138e40 legacy=0x7fe81409db70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2231376508 0 0) 0x7fe81409e280 con 0x7fe81413f250 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient(hunting): my global_id is 5872 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7fc003520 con 0x7fe81413f250 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156517770 0 0) 0x7fe808001110 con 0x7fe814139220 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient(hunting): my global_id is 5979 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe81409e280 con 0x7fe814139220 2024-09-11T02:03:14.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2206487444 0 0) 0x7fe7fc003520 con 0x7fe81413f250 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 >> v1:172.21.15.203:6791/0 conn(0x7fe814138e40 legacy=0x7fe81409db70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 >> v1:172.21.15.203:6790/0 conn(0x7fe814139220 legacy=0x7fe81413db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: _finish_hunting 0 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 monclient: found mon.noname-c 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81409d470 con 0x7fe81413f250 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: _finish_auth 0 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: _check_auth_tickets 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe80c001bb0 con 0x7fe81413f250 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 5 monclient: authenticate success, global_id 5872 2024-09-11T02:03:14.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: dump: 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.743 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe80c001dd0 con 0x7fe81413f250 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 1 -- 172.21.15.73:0/3700769311 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe80c004f60 con 0x7fe81413f250 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 10 monclient: get_monmap_and_config success 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe81a218640 4 set_mon_vals no callback set 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:03:14.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.727+0000 7fe8127fc640 10 monclient: dump: 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.745 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.728+0000 7fe81a218640 10 monclient: shutdown 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.728+0000 7fe81a218640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.728+0000 7fe81a218640 1 -- 172.21.15.73:0/3700769311 >> v1:172.21.15.73:6791/0 conn(0x7fe81413f250 legacy=0x7fe814141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.728+0000 7fe81a218640 1 -- 172.21.15.73:0/3700769311 shutdown_connections 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.728+0000 7fe81a218640 1 -- 172.21.15.73:0/3700769311 >> 172.21.15.73:0/3700769311 conn(0x7fe8140abe10 msgr2=0x7fe8140a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.728+0000 7fe81a218640 1 -- 172.21.15.73:0/3700769311 shutdown_connections 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.728+0000 7fe81a218640 1 -- 172.21.15.73:0/3700769311 wait complete. 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.728+0000 7fe81a218640 10 monclient: build_initial_monmap 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.728+0000 7fe81a218640 10 monclient: monmap: 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:03:14.746 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:14.747 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 1 Processor -- start 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 1 -- start start 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 10 monclient: init 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 10 monclient: _add_conns ranks=[2,5,4,0,8,6,1,7,3] 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 10 monclient(hunting): picked mon.noname-b con 0x7fe814138e40 addr v1:172.21.15.73:6790/0 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 10 monclient(hunting): picked mon.noname-h con 0x7fe814139220 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 10 monclient(hunting): picked mon.noname-c con 0x7fe81413f250 addr v1:172.21.15.73:6791/0 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8140a4b00 con 0x7fe814138e40 2024-09-11T02:03:14.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81413a820 con 0x7fe81413f250 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81413a3f0 con 0x7fe814139220 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe81a218640 10 monclient(hunting): authenticate will time out at 1036.333751s 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe8137fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fe814138e40 0x7fe8140a33c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:54488/0 (socket says 172.21.15.73:54488) 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe8137fe640 1 -- 172.21.15.73:0/3042667517 learned_addr learned my addr 172.21.15.73:0/3042667517 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe813fff640 1 --1- 172.21.15.73:0/3042667517 >> v1:172.21.15.73:6791/0 conn(0x7fe81413f250 0x7fe8141d5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51734/0 (socket says 172.21.15.73:51734) 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.729+0000 7fe812ffd640 1 -- 172.21.15.73:0/3042667517 >> v1:172.21.15.203:6791/0 conn(0x7fe814139220 legacy=0x7fe8140a3ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715021941 0 0) 0x7fe81413a820 con 0x7fe81413f250 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): my global_id is 5881 2024-09-11T02:03:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe800003550 con 0x7fe81413f250 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896283481 0 0) 0x7fe8140a4b00 con 0x7fe814138e40 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): my global_id is 134291 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe81413a820 con 0x7fe814138e40 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3111495842 0 0) 0x7fe81413a820 con 0x7fe814138e40 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8140a4b00 con 0x7fe814138e40 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1683126017 0 0) 0x7fe800003550 con 0x7fe81413f250 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe81413a820 con 0x7fe81413f250 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe8040043b0 con 0x7fe814138e40 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:03:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): dump: 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe80c001400 con 0x7fe81413f250 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient(hunting): dump: 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3848582298 0 0) 0x7fe8140a4b00 con 0x7fe814138e40 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 >> v1:172.21.15.203:6791/0 conn(0x7fe814139220 legacy=0x7fe8140a3ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 >> v1:172.21.15.73:6791/0 conn(0x7fe81413f250 legacy=0x7fe8141d5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient: _finish_hunting 0 2024-09-11T02:03:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 monclient: found mon.b 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe814139900 con 0x7fe814138e40 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient: _finish_auth 0 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient: _check_auth_tickets 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe81a218640 5 monclient: authenticate success, global_id 134291 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe81a218640 10 monclient: _renew_subs 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe81a218640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8140a41e0 con 0x7fe814138e40 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe81a218640 10 monclient: _renew_subs 2024-09-11T02:03:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe81a218640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8141d75a0 con 0x7fe814138e40 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe804004930 con 0x7fe814138e40 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe804004e60 con 0x7fe814138e40 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe811ffb640 4 set_mon_vals no callback set 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.730+0000 7fe7fbfff640 10 monclient: dump: 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe81a218640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe7f40065c0 con 0x7fe7f4002860 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fe804005080 con 0x7fe814138e40 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(219..219 src has 1..219) ==== 3898+0+0 (unknown 2053663681 0 0) 0x7fe80404e430 con 0x7fe814138e40 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575233990 0 0) 0x7fe7f40065c0 con 0x7fe7f4002860 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe7fbfff640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe7fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe7fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe7fbfff640 10 monclient(hunting): my global_id is 6102 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.731+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8140a4b00 con 0x7fe7f4002860 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2896659684 0 0) 0x7fe8140a4b00 con 0x7fe7f4002860 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7f40065c0 con 0x7fe7f4002860 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe813fff640 10 monclient: get_auth_request con 0x7fe800040290 auth_method 0 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe808001b30 con 0x7fe7f4002860 2024-09-11T02:03:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 10 monclient: dump: 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3261475556 0 0) 0x7fe7f40065c0 con 0x7fe7f4002860 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7f400a160 con 0x7fe7f4002860 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe808001130 con 0x7fe7f4002860 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 >> v1:172.21.15.73:6789/0 conn(0x7fe7f4002860 legacy=0x7fe7f4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.732+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 >> v1:172.21.15.73:6789/0 conn(0x7fe7f4002860 legacy=0x7fe7f4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.738+0000 7fe81a218640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:03:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.738+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe7f4009e70 con 0x7fe7f4009130 2024-09-11T02:03:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.738+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596614652 0 0) 0x7fe7f4009e70 con 0x7fe7f4009130 2024-09-11T02:03:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.738+0000 7fe7fbfff640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.738+0000 7fe7fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.738+0000 7fe7fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.738+0000 7fe7fbfff640 10 monclient(hunting): my global_id is 6111 2024-09-11T02:03:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.738+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7f40065c0 con 0x7fe7f4009130 2024-09-11T02:03:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.738+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3122909879 0 0) 0x7fe7f40065c0 con 0x7fe7f4009130 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7f4009e70 con 0x7fe7f4009130 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe808003c40 con 0x7fe7f4009130 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 10 monclient: dump: 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.762 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2798582480 0 0) 0x7fe7f4009e70 con 0x7fe7f4009130 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 --> v1:172.21.15.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe7f400c410 con 0x7fe7f4009130 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7691 (unknown 0 0 2617726677) 0x7fe8080057c0 con 0x7fe7f4009130 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:03:14.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 >> v1:172.21.15.73:6789/0 conn(0x7fe7f4009130 legacy=0x7fe7f40095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe7fbfff640 1 -- 172.21.15.73:0/3042667517 >> v1:172.21.15.73:6789/0 conn(0x7fe7f4009130 legacy=0x7fe7f40095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:14.764 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:03:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:03:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:03:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-09-11T02:03:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 46, 2024-09-11T02:03:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 317179, 2024-09-11T02:03:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:03:14.764 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:14.765 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:14.766 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:03:14.767 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:03:14.768 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:14.769 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.770 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.771 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.772 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:03:14.773 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.774 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.775 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.776 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:03:14.777 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.778 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.779 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:03:14.780 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.781 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:14.782 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:03:14.783 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 >> v1:172.21.15.203:6812/2311533528 conn(0x7fe800040290 legacy=0x7fe800042750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe81a218640 10 monclient: shutdown 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe81a218640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 >> v1:172.21.15.73:6790/0 conn(0x7fe814138e40 legacy=0x7fe8140a33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe813fff640 1 -- 172.21.15.73:0/3042667517 reap_dead start 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe813fff640 1 -- 172.21.15.73:0/3042667517 reap_dead start 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 shutdown_connections 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 >> 172.21.15.73:0/3042667517 conn(0x7fe8140abe10 msgr2=0x7fe8141370e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 shutdown_connections 2024-09-11T02:03:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.739+0000 7fe81a218640 1 -- 172.21.15.73:0/3042667517 wait complete. 2024-09-11T02:03:14.786 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T02:03:14.786 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon b 2024-09-11T02:03:14.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T02:03:14.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.882+0000 7f812e632640 10 monclient: get_monmap_and_config 2024-09-11T02:03:14.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.882+0000 7f812e632640 10 monclient: build_initial_monmap 2024-09-11T02:03:14.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.882+0000 7f812e632640 10 monclient: monmap: 2024-09-11T02:03:14.884 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:14.884 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.884 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:03:14.883514+0000 2024-09-11T02:03:14.884 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:03:14.883514+0000 2024-09-11T02:03:14.884 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:14.884 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:14.885 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.883+0000 7f812e632640 1 Processor -- start 2024-09-11T02:03:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.883+0000 7f812e632640 1 -- start start 2024-09-11T02:03:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.883+0000 7f812e632640 10 monclient: init 2024-09-11T02:03:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.883+0000 7f812e632640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.883+0000 7f812e632640 10 monclient: _add_conns ranks=[3,2,7,6,4,8,1,5,0] 2024-09-11T02:03:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 10 monclient(hunting): picked mon.noname-g con 0x7f8128138e40 addr v1:172.21.15.203:6790/0 2024-09-11T02:03:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 10 monclient(hunting): picked mon.noname-b con 0x7f8128139220 addr v1:172.21.15.73:6790/0 2024-09-11T02:03:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 10 monclient(hunting): picked mon.noname-i con 0x7f812813f250 addr v1:172.21.15.203:6792/0 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812809d190 con 0x7f8128139220 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812809e280 con 0x7f8128138e40 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812809ceb0 con 0x7f812813f250 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 10 monclient(hunting): authenticate will time out at 1036.488076s 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f81277fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f8128139220 0x7f812813db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:54492/0 (socket says 172.21.15.73:54492) 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f81277fe640 1 -- 172.21.15.73:0/281294819 learned_addr learned my addr 172.21.15.73:0/281294819 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195420137 0 0) 0x7f811c001110 con 0x7f8128139220 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): my global_id is 134300 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8110003520 con 0x7f8128139220 2024-09-11T02:03:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402400647 0 0) 0x7f812809e280 con 0x7f8128138e40 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): my global_id is 5988 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f811c001110 con 0x7f8128138e40 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112858248 0 0) 0x7f812809ceb0 con 0x7f812813f250 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient(hunting): my global_id is 5911 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f812809e280 con 0x7f812813f250 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 25524635 0 0) 0x7f8110003520 con 0x7f8128139220 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 >> v1:172.21.15.203:6792/0 conn(0x7f812813f250 legacy=0x7f8128141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 >> v1:172.21.15.203:6790/0 conn(0x7f8128138e40 legacy=0x7f812809db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 monclient: found mon.noname-b 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812809d470 con 0x7f8128139220 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: _finish_auth 0 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f811c001a00 con 0x7f8128139220 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 5 monclient: authenticate success, global_id 134300 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: dump: 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f811c001c20 con 0x7f8128139220 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 10 monclient: get_monmap_and_config success 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 1 -- 172.21.15.73:0/281294819 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f811c004be0 con 0x7f8128139220 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f812e632640 4 set_mon_vals no callback set 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.884+0000 7f8126ffd640 10 monclient: dump: 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.885+0000 7f812e632640 10 monclient: shutdown 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.885+0000 7f812e632640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.885+0000 7f812e632640 1 -- 172.21.15.73:0/281294819 >> v1:172.21.15.73:6790/0 conn(0x7f8128139220 legacy=0x7f812813db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.885+0000 7f812e632640 1 -- 172.21.15.73:0/281294819 shutdown_connections 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.885+0000 7f812e632640 1 -- 172.21.15.73:0/281294819 >> 172.21.15.73:0/281294819 conn(0x7f81280abe10 msgr2=0x7f81280a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.885+0000 7f812e632640 1 -- 172.21.15.73:0/281294819 shutdown_connections 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.885+0000 7f812e632640 1 -- 172.21.15.73:0/281294819 wait complete. 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.885+0000 7f812e632640 10 monclient: build_initial_monmap 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.885+0000 7f812e632640 10 monclient: monmap: 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:14.900 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 1 Processor -- start 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 1 -- start start 2024-09-11T02:03:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 10 monclient: init 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 10 monclient: _add_conns ranks=[1,6,5,7,2,4,3,8,0] 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 10 monclient(hunting): picked mon.noname-f con 0x7f8128138e40 addr v1:172.21.15.203:6789/0 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 10 monclient(hunting): picked mon.noname-d con 0x7f8128139220 addr v1:172.21.15.73:6792/0 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 10 monclient(hunting): picked mon.noname-h con 0x7f812813f250 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812813a820 con 0x7f8128138e40 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8128142a00 con 0x7f812813f250 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81280a4b90 con 0x7f8128139220 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f8127fff640 1 -- >> v1:172.21.15.203:6789/0 conn(0x7f8128138e40 legacy=0x7f81280a33c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.203:6789/0 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:14.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812e632640 10 monclient(hunting): authenticate will time out at 1036.490822s 2024-09-11T02:03:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f812cbcf640 1 -- >> v1:172.21.15.203:6791/0 conn(0x7f812813f250 legacy=0x7f81281d5ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f81277fe640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f8128139220 0x7f81280a3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:42866/0 (socket says 172.21.15.73:42866) 2024-09-11T02:03:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.886+0000 7f81277fe640 1 -- 172.21.15.73:0/1115444609 learned_addr learned my addr 172.21.15.73:0/1115444609 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652113994 0 0) 0x7f81280a4b90 con 0x7f8128139220 2024-09-11T02:03:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient(hunting): my global_id is 115080 2024-09-11T02:03:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8114003520 con 0x7f8128139220 2024-09-11T02:03:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 187458854 0 0) 0x7f8114003520 con 0x7f8128139220 2024-09-11T02:03:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81280a4b90 con 0x7f8128139220 2024-09-11T02:03:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f811c004b20 con 0x7f8128139220 2024-09-11T02:03:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:14.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:03:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient(hunting): dump: 2024-09-11T02:03:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.905 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.906 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.906 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.906 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.906 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.906 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.906 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.906 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.906 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2477694196 0 0) 0x7f81280a4b90 con 0x7f8128139220 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 >> v1:172.21.15.203:6791/0 conn(0x7f812813f250 legacy=0x7f81281d5ca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 >> v1:172.21.15.203:6789/0 conn(0x7f8128138e40 legacy=0x7f81280a33c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 monclient: found mon.d 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812813b0c0 con 0x7f8128139220 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient: _finish_auth 0 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f812e632640 5 monclient: authenticate success, global_id 115080 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f812e632640 10 monclient: _renew_subs 2024-09-11T02:03:14.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f812e632640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8128139900 con 0x7f8128139220 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f812e632640 10 monclient: _renew_subs 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f812e632640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f81280a41e0 con 0x7f8128139220 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f811c005150 con 0x7f8128139220 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f811c005640 con 0x7f8128139220 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f8124ff9640 10 monclient: dump: 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.908 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.887+0000 7f81267fc640 4 set_mon_vals no callback set 2024-09-11T02:03:14.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f812e632640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f81280a6d40 con 0x7f812809eb10 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f811c011d80 con 0x7f8128139220 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(219..219 src has 1..219) ==== 3898+0+0 (unknown 2053663681 0 0) 0x7f811c04e8b0 con 0x7f8128139220 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509168668 0 0) 0x7f81280a6d40 con 0x7f812809eb10 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 10 monclient(hunting): my global_id is 134309 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81280a4b90 con 0x7f812809eb10 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3087894007 0 0) 0x7f81280a4b90 con 0x7f812809eb10 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81280a6d40 con 0x7f812809eb10 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f812cbcf640 10 monclient: get_auth_request con 0x7f811403faf0 auth_method 0 2024-09-11T02:03:14.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8118001920 con 0x7f812809eb10 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.888+0000 7f8124ff9640 10 monclient: dump: 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.889+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3119547448 0 0) 0x7f81280a6d40 con 0x7f812809eb10 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.889+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81280008d0 con 0x7f812809eb10 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.889+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8118001d00 con 0x7f812809eb10 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.889+0000 7f8124ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.889+0000 7f8124ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.889+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 >> v1:172.21.15.73:6790/0 conn(0x7f812809eb10 legacy=0x7f812809eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.889+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 >> v1:172.21.15.73:6790/0 conn(0x7f812809eb10 legacy=0x7f812809eef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f812e632640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f812809f9e0 con 0x7f812809f600 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1532242528 0 0) 0x7f812809f9e0 con 0x7f812809f600 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 10 monclient(hunting): my global_id is 134318 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81280a6d40 con 0x7f812809f600 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1165627647 0 0) 0x7f81280a6d40 con 0x7f812809f600 2024-09-11T02:03:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f812809f9e0 con 0x7f812809f600 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8118003ba0 con 0x7f812809f600 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 10 monclient: dump: 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:14.915 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2953249406 0 0) 0x7f812809f9e0 con 0x7f812809f600 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.895+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 --> v1:172.21.15.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8128139600 con 0x7f812809f600 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7521 (unknown 0 0 1921138062) 0x7f8118003e40 con 0x7f812809f600 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f8124ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f8124ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:03:14.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 >> v1:172.21.15.73:6790/0 conn(0x7f812809f600 legacy=0x7f81281db3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f8124ff9640 1 -- 172.21.15.73:0/1115444609 >> v1:172.21.15.73:6790/0 conn(0x7f812809f600 legacy=0x7f81281db3e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 46, 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 30598, 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:03:14.917 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:14.918 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:14.919 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:03:14.920 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:14.921 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:03:14.922 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.924 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.925 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.926 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.927 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.928 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:03:14.929 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.930 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.931 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.932 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:03:14.933 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:14.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:14.935 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:14.936 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:03:14.936 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:03:14.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 >> v1:172.21.15.203:6812/2311533528 conn(0x7f811403faf0 legacy=0x7f8114041fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812e632640 10 monclient: shutdown 2024-09-11T02:03:14.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812e632640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 >> v1:172.21.15.73:6792/0 conn(0x7f8128139220 legacy=0x7f81280a3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812cbcf640 1 -- 172.21.15.73:0/1115444609 reap_dead start 2024-09-11T02:03:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812cbcf640 1 -- 172.21.15.73:0/1115444609 reap_dead start 2024-09-11T02:03:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 shutdown_connections 2024-09-11T02:03:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 >> 172.21.15.73:0/1115444609 conn(0x7f81280abe10 msgr2=0x7f8128137770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 shutdown_connections 2024-09-11T02:03:14.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:14.896+0000 7f812e632640 1 -- 172.21.15.73:0/1115444609 wait complete. 2024-09-11T02:03:14.938 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T02:03:14.939 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon c 2024-09-11T02:03:14.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T02:03:15.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.036+0000 7fdaca69b640 10 monclient: get_monmap_and_config 2024-09-11T02:03:15.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.036+0000 7fdaca69b640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.037+0000 7fdaca69b640 10 monclient: monmap: 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:03:15.037857+0000 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:03:15.037857+0000 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.039 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.040 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.040 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.037+0000 7fdaca69b640 1 Processor -- start 2024-09-11T02:03:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.037+0000 7fdaca69b640 1 -- start start 2024-09-11T02:03:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.037+0000 7fdaca69b640 10 monclient: init 2024-09-11T02:03:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 10 monclient: _add_conns ranks=[2,6,8,5,3,1,0,7,4] 2024-09-11T02:03:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 10 monclient(hunting): picked mon.noname-b con 0x7fdac4138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:03:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 10 monclient(hunting): picked mon.noname-d con 0x7fdac40a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T02:03:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 10 monclient(hunting): picked mon.noname-e con 0x7fdac413f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:03:15.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac409ca00 con 0x7fdac4138d40 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac40a7070 con 0x7fdac40a72f0 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac409cee0 con 0x7fdac413f350 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 10 monclient(hunting): authenticate will time out at 1036.642310s 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac3fff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fdac4138d40 0x7fdac4139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:54504/0 (socket says 172.21.15.73:54504) 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac3fff640 1 -- 172.21.15.73:0/3860440617 learned_addr learned my addr 172.21.15.73:0/3860440617 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac37fe640 1 --1- 172.21.15.73:0/3860440617 >> v1:172.21.15.73:6792/0 conn(0x7fdac40a72f0 0x7fdac413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:42878/0 (socket says 172.21.15.73:42878) 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883815307 0 0) 0x7fdac409ca00 con 0x7fdac4138d40 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): my global_id is 134327 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaac003520 con 0x7fdac4138d40 2024-09-11T02:03:15.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705002390 0 0) 0x7fdac409cee0 con 0x7fdac413f350 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): my global_id is 115055 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac409ca00 con 0x7fdac413f350 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2657684738 0 0) 0x7fdac40a7070 con 0x7fdac40a72f0 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient(hunting): my global_id is 115089 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac409cee0 con 0x7fdac40a72f0 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1884512969 0 0) 0x7fdaac003520 con 0x7fdac4138d40 2024-09-11T02:03:15.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 >> v1:172.21.15.73:6793/0 conn(0x7fdac413f350 legacy=0x7fdac4141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 >> v1:172.21.15.73:6792/0 conn(0x7fdac40a72f0 legacy=0x7fdac413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 monclient: found mon.noname-b 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac409d1c0 con 0x7fdac4138d40 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdab4001850 con 0x7fdac4138d40 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 5 monclient: authenticate success, global_id 134327 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdaca69b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.038+0000 7fdac2ffd640 10 monclient: dump: 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.053 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdab40019f0 con 0x7fdac4138d40 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdac2ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3860440617 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdab4004be0 con 0x7fdac4138d40 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 10 monclient: get_monmap_and_config success 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 4 set_mon_vals no callback set 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdac2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdac2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdac2ffd640 10 monclient: dump: 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.054 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 10 monclient: shutdown 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 1 -- 172.21.15.73:0/3860440617 >> v1:172.21.15.73:6790/0 conn(0x7fdac4138d40 legacy=0x7fdac4139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 1 -- 172.21.15.73:0/3860440617 shutdown_connections 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 1 -- 172.21.15.73:0/3860440617 >> 172.21.15.73:0/3860440617 conn(0x7fdac40a8050 msgr2=0x7fdac40a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 1 -- 172.21.15.73:0/3860440617 shutdown_connections 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.039+0000 7fdaca69b640 1 -- 172.21.15.73:0/3860440617 wait complete. 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.040+0000 7fdaca69b640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.040+0000 7fdaca69b640 10 monclient: monmap: 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.056 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.040+0000 7fdaca69b640 1 Processor -- start 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.040+0000 7fdaca69b640 1 -- start start 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.040+0000 7fdaca69b640 10 monclient: init 2024-09-11T02:03:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 10 monclient: _add_conns ranks=[3,7,8,4,1,6,0,5,2] 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 10 monclient(hunting): picked mon.noname-g con 0x7fdac40a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 10 monclient(hunting): picked mon.noname-i con 0x7fdac4138d40 addr v1:172.21.15.203:6792/0 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 10 monclient(hunting): picked mon.noname-e con 0x7fdac413f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac413b3c0 con 0x7fdac40a72f0 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac413b6a0 con 0x7fdac4138d40 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac41416b0 con 0x7fdac413f350 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 10 monclient(hunting): authenticate will time out at 1036.645247s 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac8c38640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fdac413f350 0x7fdac41d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:44318/0 (socket says 172.21.15.73:44318) 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac8c38640 1 -- 172.21.15.73:0/2433942326 learned_addr learned my addr 172.21.15.73:0/2433942326 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381711841 0 0) 0x7fdac41416b0 con 0x7fdac413f350 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): my global_id is 115064 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdab0003520 con 0x7fdac413f350 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223177605 0 0) 0x7fdac413b6a0 con 0x7fdac4138d40 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): my global_id is 5920 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac41416b0 con 0x7fdac4138d40 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629242676 0 0) 0x7fdac413b3c0 con 0x7fdac40a72f0 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): my global_id is 5997 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac413b6a0 con 0x7fdac40a72f0 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3293797251 0 0) 0x7fdab0003520 con 0x7fdac413f350 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdac413b3c0 con 0x7fdac413f350 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdabc001dd0 con 0x7fdac413f350 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): dump: 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3148842640 0 0) 0x7fdac413b6a0 con 0x7fdac40a72f0 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdab0003520 con 0x7fdac40a72f0 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdab4001020 con 0x7fdac40a72f0 2024-09-11T02:03:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): dump: 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3057432611 0 0) 0x7fdac41416b0 con 0x7fdac4138d40 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdac413b6a0 con 0x7fdac4138d40 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdab8001550 con 0x7fdac4138d40 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient(hunting): dump: 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3868498752 0 0) 0x7fdac413b3c0 con 0x7fdac413f350 2024-09-11T02:03:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 >> v1:172.21.15.203:6792/0 conn(0x7fdac4138d40 legacy=0x7fdac4140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 >> v1:172.21.15.203:6790/0 conn(0x7fdac40a72f0 legacy=0x7fdac4140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 monclient: found mon.e 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac413b0e0 con 0x7fdac413f350 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdac0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 5 monclient: authenticate success, global_id 115064 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 10 monclient: _renew_subs 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:03:15.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.041+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdac41383d0 con 0x7fdac413f350 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdaca69b640 10 monclient: _renew_subs 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdaca69b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fdac413e1f0 con 0x7fdac413f350 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdabc003c20 con 0x7fdac413f350 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdac0ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdabc004190 con 0x7fdac413f350 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdac0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdac27fc640 4 set_mon_vals no callback set 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdac0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdac0ff9640 10 monclient: dump: 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdaca69b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdaa40065c0 con 0x7fdaa4002860 2024-09-11T02:03:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.042+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fdabc004330 con 0x7fdac413f350 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(219..219 src has 1..219) ==== 3898+0+0 (unknown 2053663681 0 0) 0x7fdabc04e730 con 0x7fdac413f350 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561412937 0 0) 0x7fdaa40065c0 con 0x7fdaa4002860 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 10 monclient(hunting): my global_id is 5890 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac413b3c0 con 0x7fdaa4002860 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac37fe640 10 monclient: get_auth_request con 0x7fdab0040760 auth_method 0 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2343102537 0 0) 0x7fdac413b3c0 con 0x7fdaa4002860 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdaa40065c0 con 0x7fdaa4002860 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdab4001840 con 0x7fdaa4002860 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 10 monclient: dump: 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1363649612 0 0) 0x7fdaa40065c0 con 0x7fdaa4002860 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdaa400a160 con 0x7fdaa4002860 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdab4007480 con 0x7fdaa4002860 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 >> v1:172.21.15.73:6791/0 conn(0x7fdaa4002860 legacy=0x7fdaa4004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.043+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 >> v1:172.21.15.73:6791/0 conn(0x7fdaa4002860 legacy=0x7fdaa4004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.049+0000 7fdaca69b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.049+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdaa4009e50 con 0x7fdaa4009110 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887023927 0 0) 0x7fdaa4009e50 con 0x7fdaa4009110 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 10 monclient(hunting): my global_id is 5899 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa40065c0 con 0x7fdaa4009110 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1893016816 0 0) 0x7fdaa40065c0 con 0x7fdaa4009110 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdaa4009e50 con 0x7fdaa4009110 2024-09-11T02:03:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fdab4005670 con 0x7fdaa4009110 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 10 monclient: dump: 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.073 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2441706167 0 0) 0x7fdaa4009e50 con 0x7fdaa4009110 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 --> v1:172.21.15.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdaa400c3f0 con 0x7fdaa4009110 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7689 (unknown 0 0 3789092337) 0x7fdab4007630 con 0x7fdaa4009110 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 >> v1:172.21.15.73:6791/0 conn(0x7fdaa4009110 legacy=0x7fdaa40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.050+0000 7fdac0ff9640 1 -- 172.21.15.73:0/2433942326 >> v1:172.21.15.73:6791/0 conn(0x7fdaa4009110 legacy=0x7fdaa40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 46, 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 317513, 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:03:15.075 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.076 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.077 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.078 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.079 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:03:15.080 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.081 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.082 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.085 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:03:15.086 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.089 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:03:15.090 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.091 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.092 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.093 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:03:15.094 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:03:15.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 >> v1:172.21.15.203:6812/2311533528 conn(0x7fdab0040760 legacy=0x7fdab0042c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdaca69b640 10 monclient: shutdown 2024-09-11T02:03:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdaca69b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 >> v1:172.21.15.73:6793/0 conn(0x7fdac413f350 legacy=0x7fdac41d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdac8c38640 1 -- 172.21.15.73:0/2433942326 reap_dead start 2024-09-11T02:03:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdac8c38640 1 -- 172.21.15.73:0/2433942326 reap_dead start 2024-09-11T02:03:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 shutdown_connections 2024-09-11T02:03:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 >> 172.21.15.73:0/2433942326 conn(0x7fdac40a8050 msgr2=0x7fdac413ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 shutdown_connections 2024-09-11T02:03:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.051+0000 7fdaca69b640 1 -- 172.21.15.73:0/2433942326 wait complete. 2024-09-11T02:03:15.096 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T02:03:15.097 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon d 2024-09-11T02:03:15.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-11T02:03:15.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.194+0000 7fac1e465640 10 monclient: get_monmap_and_config 2024-09-11T02:03:15.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.194+0000 7fac1e465640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.195+0000 7fac1e465640 10 monclient: monmap: 2024-09-11T02:03:15.196 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:03:15.195861+0000 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:03:15.195861+0000 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.198 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.195+0000 7fac1e465640 1 Processor -- start 2024-09-11T02:03:15.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.195+0000 7fac1e465640 1 -- start start 2024-09-11T02:03:15.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.195+0000 7fac1e465640 10 monclient: init 2024-09-11T02:03:15.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 10 monclient: _add_conns ranks=[5,3,4,1,2,8,7,6,0] 2024-09-11T02:03:15.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 10 monclient(hunting): picked mon.noname-h con 0x7fac18138d40 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 10 monclient(hunting): picked mon.noname-g con 0x7fac180a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 10 monclient(hunting): picked mon.noname-c con 0x7fac1813f350 addr v1:172.21.15.73:6791/0 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1809ca00 con 0x7fac180a72f0 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac180a7070 con 0x7fac1813f350 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1809cee0 con 0x7fac18138d40 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1e465640 10 monclient(hunting): authenticate will time out at 1036.800465s 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac17fff640 1 -- >> v1:172.21.15.203:6791/0 conn(0x7fac18138d40 legacy=0x7fac18139120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1ca02640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fac1813f350 0x7fac18141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:51764/0 (socket says 172.21.15.73:51764) 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac1ca02640 1 -- 172.21.15.73:0/2044740208 learned_addr learned my addr 172.21.15.73:0/2044740208 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544384450 0 0) 0x7fac180a7070 con 0x7fac1813f350 2024-09-11T02:03:15.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac177fe640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac177fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac177fe640 10 monclient(hunting): my global_id is 5908 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.196+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac04003520 con 0x7fac1813f350 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258875127 0 0) 0x7fac1809ca00 con 0x7fac180a72f0 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient(hunting): my global_id is 6006 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac180a7070 con 0x7fac180a72f0 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2817619962 0 0) 0x7fac04003520 con 0x7fac1813f350 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 >> v1:172.21.15.203:6791/0 conn(0x7fac18138d40 legacy=0x7fac18139120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:03:15.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 >> v1:172.21.15.203:6790/0 conn(0x7fac180a72f0 legacy=0x7fac1813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 monclient: found mon.noname-c 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1809d1c0 con 0x7fac1813f350 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac10001bb0 con 0x7fac1813f350 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 5 monclient: authenticate success, global_id 5908 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: dump: 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.210 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac10001dd0 con 0x7fac1813f350 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 1 -- 172.21.15.73:0/2044740208 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac10004f60 con 0x7fac1813f350 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 10 monclient: get_monmap_and_config success 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 4 set_mon_vals no callback set 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac177fe640 10 monclient: dump: 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.211 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 10 monclient: shutdown 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 1 -- 172.21.15.73:0/2044740208 >> v1:172.21.15.73:6791/0 conn(0x7fac1813f350 legacy=0x7fac18141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 1 -- 172.21.15.73:0/2044740208 shutdown_connections 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 1 -- 172.21.15.73:0/2044740208 >> 172.21.15.73:0/2044740208 conn(0x7fac180a8050 msgr2=0x7fac180a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 1 -- 172.21.15.73:0/2044740208 shutdown_connections 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.197+0000 7fac1e465640 1 -- 172.21.15.73:0/2044740208 wait complete. 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.198+0000 7fac1e465640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.198+0000 7fac1e465640 10 monclient: monmap: 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.198+0000 7fac1e465640 1 Processor -- start 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.198+0000 7fac1e465640 1 -- start start 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.198+0000 7fac1e465640 10 monclient: init 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 10 monclient: _add_conns ranks=[5,6,7,8,1,2,3,0,4] 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 10 monclient(hunting): picked mon.noname-h con 0x7fac180a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 10 monclient(hunting): picked mon.noname-d con 0x7fac18138d40 addr v1:172.21.15.73:6792/0 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 10 monclient(hunting): picked mon.noname-i con 0x7fac1813f350 addr v1:172.21.15.203:6792/0 2024-09-11T02:03:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac180a0d00 con 0x7fac180a72f0 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac180a14f0 con 0x7fac18138d40 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1809fa60 con 0x7fac1813f350 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac1e465640 10 monclient(hunting): authenticate will time out at 1036.803390s 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac17fff640 1 -- >> v1:172.21.15.203:6791/0 conn(0x7fac180a72f0 legacy=0x7fac1809ec40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac0ffff640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fac18138d40 0x7fac1809f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:42894/0 (socket says 172.21.15.73:42894) 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac0ffff640 1 -- 172.21.15.73:0/2490584146 learned_addr learned my addr 172.21.15.73:0/2490584146 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484721279 0 0) 0x7fac180a7070 con 0x7fac18138d40 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): my global_id is 115098 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabf8003520 con 0x7fac18138d40 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2126565764 0 0) 0x7fac1809fa60 con 0x7fac1813f350 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): my global_id is 5929 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac180a7070 con 0x7fac1813f350 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2473781894 0 0) 0x7fabf8003520 con 0x7fac18138d40 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac1809fa60 con 0x7fac18138d40 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac00001b30 con 0x7fac18138d40 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): dump: 2024-09-11T02:03:15.217 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.218 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.199+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3118291896 0 0) 0x7fac1809fa60 con 0x7fac18138d40 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 >> v1:172.21.15.203:6792/0 conn(0x7fac1813f350 legacy=0x7fac181d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 >> v1:172.21.15.203:6791/0 conn(0x7fac180a72f0 legacy=0x7fac1809ec40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 1 monclient: found mon.d 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac181424f0 con 0x7fac18138d40 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac1e465640 5 monclient: authenticate success, global_id 115098 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac1e465640 10 monclient: _renew_subs 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac1e465640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fac180a0590 con 0x7fac18138d40 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac1e465640 10 monclient: _renew_subs 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac1e465640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fac181387e0 con 0x7fac18138d40 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac000038c0 con 0x7fac18138d40 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac00003eb0 con 0x7fac18138d40 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac16ffd640 4 set_mon_vals no callback set 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:03:15.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 10 monclient: dump: 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.221 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.200+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fac00004050 con 0x7fac18138d40 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac1e465640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fabfc0065c0 con 0x7fabfc002860 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(219..219 src has 1..219) ==== 3898+0+0 (unknown 2053663681 0 0) 0x7fac0004e470 con 0x7fac18138d40 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217233926 0 0) 0x7fabfc0065c0 con 0x7fabfc002860 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 10 monclient(hunting): my global_id is 115107 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac1809fa60 con 0x7fabfc002860 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac1ca02640 10 monclient: get_auth_request con 0x7fabf803fcf0 auth_method 0 2024-09-11T02:03:15.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3541247123 0 0) 0x7fac1809fa60 con 0x7fabfc002860 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fabfc0065c0 con 0x7fabfc002860 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac08004170 con 0x7fabfc002860 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 10 monclient: dump: 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.223 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1728764601 0 0) 0x7fabfc0065c0 con 0x7fabfc002860 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabfc00a160 con 0x7fabfc002860 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fac080064b0 con 0x7fabfc002860 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:03:15.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 >> v1:172.21.15.73:6792/0 conn(0x7fabfc002860 legacy=0x7fabfc004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.201+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 >> v1:172.21.15.73:6792/0 conn(0x7fabfc002860 legacy=0x7fabfc004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac1e465640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:03:15.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fabfc009e70 con 0x7fabfc009130 2024-09-11T02:03:15.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286004681 0 0) 0x7fabfc009e70 con 0x7fabfc009130 2024-09-11T02:03:15.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 10 monclient(hunting): my global_id is 115116 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabfc0065c0 con 0x7fabfc009130 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1947215934 0 0) 0x7fabfc0065c0 con 0x7fabfc009130 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fabfc009e70 con 0x7fabfc009130 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fac08004b00 con 0x7fabfc009130 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 10 monclient: dump: 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.227 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2679093688 0 0) 0x7fabfc009e70 con 0x7fabfc009130 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 --> v1:172.21.15.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fabfc00c410 con 0x7fabfc009130 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7522 (unknown 0 0 3264177808) 0x7fac08006010 con 0x7fabfc009130 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:03:15.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 >> v1:172.21.15.73:6792/0 conn(0x7fabfc009130 legacy=0x7fabfc0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.208+0000 7fac157fa640 1 -- 172.21.15.73:0/2490584146 >> v1:172.21.15.73:6792/0 conn(0x7fabfc009130 legacy=0x7fabfc0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 46, 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 161796, 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:03:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.230 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.231 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:03:15.232 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:03:15.233 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.234 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.235 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.237 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.238 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.239 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.240 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.242 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.243 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.244 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.246 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.247 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:03:15.248 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:03:15.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 >> v1:172.21.15.203:6812/2311533528 conn(0x7fabf803fcf0 legacy=0x7fabf80421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1e465640 10 monclient: shutdown 2024-09-11T02:03:15.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1e465640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 >> v1:172.21.15.73:6792/0 conn(0x7fac18138d40 legacy=0x7fac1809f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1ca02640 1 -- 172.21.15.73:0/2490584146 reap_dead start 2024-09-11T02:03:15.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1ca02640 1 -- 172.21.15.73:0/2490584146 reap_dead start 2024-09-11T02:03:15.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 shutdown_connections 2024-09-11T02:03:15.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 >> 172.21.15.73:0/2490584146 conn(0x7fac180a8050 msgr2=0x7fac1813ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 shutdown_connections 2024-09-11T02:03:15.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.209+0000 7fac1e465640 1 -- 172.21.15.73:0/2490584146 wait complete. 2024-09-11T02:03:15.250 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T02:03:15.251 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon e 2024-09-11T02:03:15.251 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-11T02:03:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.348+0000 7f774c4d4640 10 monclient: get_monmap_and_config 2024-09-11T02:03:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.348+0000 7f774c4d4640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.348+0000 7f774c4d4640 10 monclient: monmap: 2024-09-11T02:03:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:03:15.349461+0000 2024-09-11T02:03:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:03:15.349461+0000 2024-09-11T02:03:15.350 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.351 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 1 Processor -- start 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 1 -- start start 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 10 monclient: init 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 10 monclient: _add_conns ranks=[0,1,6,2,8,4,7,3,5] 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 10 monclient(hunting): picked mon.noname-a con 0x7f7744138d40 addr v1:172.21.15.73:6789/0 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 10 monclient(hunting): picked mon.noname-f con 0x7f77440a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 10 monclient(hunting): picked mon.noname-d con 0x7f774413f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774409ca00 con 0x7f7744138d40 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77440a7070 con 0x7f77440a72f0 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774409cee0 con 0x7f774413f350 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774c4d4640 10 monclient(hunting): authenticate will time out at 1036.953866s 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f7749a6f640 1 -- >> v1:172.21.15.203:6789/0 conn(0x7f77440a72f0 legacy=0x7f774413dc30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6789/0 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774a270640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7744138d40 0x7f7744139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33128/0 (socket says 172.21.15.73:33128) 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774aa71640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f774413f350 0x7f7744141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:42930/0 (socket says 172.21.15.73:42930) 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.349+0000 7f774a270640 1 -- 172.21.15.73:0/962455639 learned_addr learned my addr 172.21.15.73:0/962455639 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468607022 0 0) 0x7f774409cee0 con 0x7f774413f350 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient(hunting): my global_id is 115125 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7730003520 con 0x7f774413f350 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646625209 0 0) 0x7f774409ca00 con 0x7f7744138d40 2024-09-11T02:03:15.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient(hunting): my global_id is 6120 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f774409cee0 con 0x7f7744138d40 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3584683654 0 0) 0x7f774409cee0 con 0x7f7744138d40 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 >> v1:172.21.15.73:6792/0 conn(0x7f774413f350 legacy=0x7f7744141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 >> v1:172.21.15.203:6789/0 conn(0x7f77440a72f0 legacy=0x7f774413dc30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 monclient: found mon.noname-a 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774409d1c0 con 0x7f7744138d40 2024-09-11T02:03:15.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774c4d4640 5 monclient: authenticate success, global_id 6120 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7740001680 con 0x7f7744138d40 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774c4d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: dump: 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774c4d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7740001820 con 0x7f7744138d40 2024-09-11T02:03:15.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774c4d4640 10 monclient: get_monmap_and_config success 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 1 -- 172.21.15.73:0/962455639 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f77400048a0 con 0x7f7744138d40 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774c4d4640 4 set_mon_vals no callback set 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.350+0000 7f774926e640 10 monclient: dump: 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.364 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 10 monclient: shutdown 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 1 -- 172.21.15.73:0/962455639 >> v1:172.21.15.73:6789/0 conn(0x7f7744138d40 legacy=0x7f7744139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 1 -- 172.21.15.73:0/962455639 shutdown_connections 2024-09-11T02:03:15.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 1 -- 172.21.15.73:0/962455639 >> 172.21.15.73:0/962455639 conn(0x7f77440a8050 msgr2=0x7f77440a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 1 -- 172.21.15.73:0/962455639 shutdown_connections 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 1 -- 172.21.15.73:0/962455639 wait complete. 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 10 monclient: monmap: 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.366 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.351+0000 7f774c4d4640 1 Processor -- start 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 1 -- start start 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 10 monclient: init 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 10 monclient: _add_conns ranks=[2,0,6,5,4,8,7,3,1] 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 10 monclient(hunting): picked mon.noname-b con 0x7f77440a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 10 monclient(hunting): picked mon.noname-a con 0x7f7744138d40 addr v1:172.21.15.73:6789/0 2024-09-11T02:03:15.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 10 monclient(hunting): picked mon.noname-d con 0x7f774413f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7744142880 con 0x7f7744138d40 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774413be70 con 0x7f77440a72f0 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77441424d0 con 0x7f774413f350 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774a270640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f77440a72f0 0x7f774413df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:54520/0 (socket says 172.21.15.73:54520) 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f7749a6f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7744138d40 0x7f77441d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33140/0 (socket says 172.21.15.73:33140) 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774a270640 1 -- 172.21.15.73:0/2701443920 learned_addr learned my addr 172.21.15.73:0/2701443920 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f774c4d4640 10 monclient(hunting): authenticate will time out at 1036.956587s 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2923850055 0 0) 0x7f77441424d0 con 0x7f774413f350 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): my global_id is 115134 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7728003520 con 0x7f774413f350 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129504751 0 0) 0x7f774413be70 con 0x7f77440a72f0 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): my global_id is 134336 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77441424d0 con 0x7f77440a72f0 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753016785 0 0) 0x7f7744142880 con 0x7f7744138d40 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 10 monclient(hunting): my global_id is 6129 2024-09-11T02:03:15.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.352+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f774413be70 con 0x7f7744138d40 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 102284425 0 0) 0x7f77441424d0 con 0x7f77440a72f0 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7744142880 con 0x7f77440a72f0 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7740001640 con 0x7f77440a72f0 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient(hunting): dump: 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.370 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2300764423 0 0) 0x7f774413be70 con 0x7f7744138d40 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77441424d0 con 0x7f7744138d40 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f77340041e0 con 0x7f7744138d40 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient(hunting): dump: 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.372 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1120891267 0 0) 0x7f7744142880 con 0x7f77440a72f0 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 >> v1:172.21.15.73:6792/0 conn(0x7f774413f350 legacy=0x7f77441d5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 >> v1:172.21.15.73:6789/0 conn(0x7f7744138d40 legacy=0x7f77441d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 monclient: found mon.b 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774413c6f0 con 0x7f77440a72f0 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f774c4d4640 5 monclient: authenticate success, global_id 134336 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f774c4d4640 10 monclient: _renew_subs 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f774c4d4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f774413e610 con 0x7f77440a72f0 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f774c4d4640 10 monclient: _renew_subs 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f774c4d4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f774413b3b0 con 0x7f77440a72f0 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77400048e0 con 0x7f77440a72f0 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7740005150 con 0x7f77440a72f0 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:03:15.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f773affd640 10 monclient: dump: 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.375 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.353+0000 7f7748a6d640 4 set_mon_vals no callback set 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f774c4d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f77400052f0 con 0x7f77440a72f0 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f772c0065c0 con 0x7f772c002860 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(219..219 src has 1..219) ==== 3898+0+0 (unknown 2053663681 0 0) 0x7f774004e450 con 0x7f77440a72f0 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806288556 0 0) 0x7f772c0065c0 con 0x7f772c002860 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f773affd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f773affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f773affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f773affd640 10 monclient(hunting): my global_id is 115073 2024-09-11T02:03:15.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.354+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7744142880 con 0x7f772c002860 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3773929316 0 0) 0x7f7744142880 con 0x7f772c002860 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f772c0065c0 con 0x7f772c002860 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f77340049c0 con 0x7f772c002860 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 10 monclient: dump: 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.377 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3233375924 0 0) 0x7f772c0065c0 con 0x7f772c002860 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f772c00a160 con 0x7f772c002860 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f774aa71640 10 monclient: get_auth_request con 0x7f7728040580 auth_method 0 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7734005f20 con 0x7f772c002860 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:03:15.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 >> v1:172.21.15.73:6793/0 conn(0x7f772c002860 legacy=0x7f772c004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.355+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 >> v1:172.21.15.73:6793/0 conn(0x7f772c002860 legacy=0x7f772c004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.361+0000 7f774c4d4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:03:15.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.361+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f772c009e70 con 0x7f772c009130 2024-09-11T02:03:15.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.361+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1135467233 0 0) 0x7f772c009e70 con 0x7f772c009130 2024-09-11T02:03:15.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.361+0000 7f773affd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.361+0000 7f773affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.361+0000 7f773affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.361+0000 7f773affd640 10 monclient(hunting): my global_id is 115082 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.361+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f772c0065c0 con 0x7f772c009130 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2628719204 0 0) 0x7f772c0065c0 con 0x7f772c009130 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f772c009e70 con 0x7f772c009130 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7734006700 con 0x7f772c009130 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 10 monclient: dump: 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.381 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1482142122 0 0) 0x7f772c009e70 con 0x7f772c009130 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 --> v1:172.21.15.73:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f772c00c410 con 0x7f772c009130 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7689 (unknown 0 0 3182779799) 0x7f7734006890 con 0x7f772c009130 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 >> v1:172.21.15.73:6793/0 conn(0x7f772c009130 legacy=0x7f772c0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f773affd640 1 -- 172.21.15.73:0/2701443920 >> v1:172.21.15.73:6793/0 conn(0x7f772c009130 legacy=0x7f772c0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:03:15.383 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 46, 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 161950, 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:03:15.384 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.385 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.386 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.387 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.388 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.400 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.401 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.402 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.403 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.404 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:03:15.404 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:03:15.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 >> v1:172.21.15.203:6812/2311533528 conn(0x7f7728040580 legacy=0x7f7728042a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774c4d4640 10 monclient: shutdown 2024-09-11T02:03:15.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774c4d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 >> v1:172.21.15.73:6790/0 conn(0x7f77440a72f0 legacy=0x7f774413df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774aa71640 1 -- 172.21.15.73:0/2701443920 reap_dead start 2024-09-11T02:03:15.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774aa71640 1 -- 172.21.15.73:0/2701443920 reap_dead start 2024-09-11T02:03:15.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 shutdown_connections 2024-09-11T02:03:15.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 >> 172.21.15.73:0/2701443920 conn(0x7f77440a8050 msgr2=0x7f77440a95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 shutdown_connections 2024-09-11T02:03:15.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.362+0000 7f774c4d4640 1 -- 172.21.15.73:0/2701443920 wait complete. 2024-09-11T02:03:15.406 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T02:03:15.407 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-09-11T02:03:15.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-11T02:03:15.408 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:15.408 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38315]: starting. 2024-09-11T02:03:15.408 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38315]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38277 2024-09-11T02:03:15.408 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38315]: shutting down. 2024-09-11T02:03:15.408 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:15.408 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:15.408 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:03:15.409 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.508+0000 7fb02e833640 10 monclient: get_monmap_and_config 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.508+0000 7fb02e833640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.508+0000 7fb02e833640 10 monclient: monmap: 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:03:15.509350+0000 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:03:15.509350+0000 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.510 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.511 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 1 Processor -- start 2024-09-11T02:03:15.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 1 -- start start 2024-09-11T02:03:15.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 10 monclient: init 2024-09-11T02:03:15.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 10 monclient: _add_conns ranks=[6,7,8,0,1,5,3,4,2] 2024-09-11T02:03:15.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 10 monclient(hunting): picked mon.noname-d con 0x7fb028138d40 addr v1:172.21.15.73:6792/0 2024-09-11T02:03:15.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 10 monclient(hunting): picked mon.noname-i con 0x7fb0280a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T02:03:15.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 10 monclient(hunting): picked mon.noname-e con 0x7fb02813f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:03:15.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb02809ca00 con 0x7fb028138d40 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0280a7070 con 0x7fb0280a72f0 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb02809cee0 con 0x7fb02813f350 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02e833640 10 monclient(hunting): authenticate will time out at 1037.113797s 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb027fff640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fb028138d40 0x7fb028139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:42942/0 (socket says 172.21.15.73:42942) 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb02cdd0640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fb02813f350 0x7fb028141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:44338/0 (socket says 172.21.15.73:44338) 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.509+0000 7fb027fff640 1 -- 172.21.15.73:0/397661898 learned_addr learned my addr 172.21.15.73:0/397661898 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726614962 0 0) 0x7fb02809ca00 con 0x7fb028138d40 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): my global_id is 115143 2024-09-11T02:03:15.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb010003520 con 0x7fb028138d40 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272360139 0 0) 0x7fb02809cee0 con 0x7fb02813f350 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): my global_id is 115118 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb02809ca00 con 0x7fb02813f350 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367887335 0 0) 0x7fb0280a7070 con 0x7fb0280a72f0 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient(hunting): my global_id is 5947 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb02809cee0 con 0x7fb0280a72f0 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1951534559 0 0) 0x7fb010003520 con 0x7fb028138d40 2024-09-11T02:03:15.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 >> v1:172.21.15.73:6793/0 conn(0x7fb02813f350 legacy=0x7fb028141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 >> v1:172.21.15.203:6792/0 conn(0x7fb0280a72f0 legacy=0x7fb02813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 monclient: found mon.noname-d 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02809d1c0 con 0x7fb028138d40 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb018001850 con 0x7fb028138d40 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb02e833640 5 monclient: authenticate success, global_id 115143 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb02e833640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: dump: 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb02e833640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0180019f0 con 0x7fb028138d40 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 1 -- 172.21.15.73:0/397661898 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb018004be0 con 0x7fb028138d40 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb026ffd640 10 monclient: dump: 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.526 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb02e833640 10 monclient: get_monmap_and_config success 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.510+0000 7fb02e833640 4 set_mon_vals no callback set 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 10 monclient: shutdown 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 1 -- 172.21.15.73:0/397661898 >> v1:172.21.15.73:6792/0 conn(0x7fb028138d40 legacy=0x7fb028139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 1 -- 172.21.15.73:0/397661898 shutdown_connections 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 1 -- 172.21.15.73:0/397661898 >> 172.21.15.73:0/397661898 conn(0x7fb0280a8050 msgr2=0x7fb0280a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 1 -- 172.21.15.73:0/397661898 shutdown_connections 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 1 -- 172.21.15.73:0/397661898 wait complete. 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 10 monclient: monmap: 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.528 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.511+0000 7fb02e833640 1 Processor -- start 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 1 -- start start 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 10 monclient: init 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 10 monclient: _add_conns ranks=[0,5,2,3,6,7,8,1,4] 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 10 monclient(hunting): picked mon.noname-a con 0x7fb0280a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 10 monclient(hunting): picked mon.noname-h con 0x7fb028138d40 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 10 monclient(hunting): picked mon.noname-b con 0x7fb02813f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0280a18d0 con 0x7fb0280a72f0 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0281427f0 con 0x7fb02813f350 2024-09-11T02:03:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb02813a800 con 0x7fb028138d40 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02e833640 10 monclient(hunting): authenticate will time out at 1037.116713s 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb0277fe640 1 -- >> v1:172.21.15.203:6791/0 conn(0x7fb028138d40 legacy=0x7fb02813a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb027fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb0280a72f0 0x7fb0281399e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33142/0 (socket says 172.21.15.73:33142) 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb02cdd0640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb02813f350 0x7fb0281d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:54526/0 (socket says 172.21.15.73:54526) 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb027fff640 1 -- 172.21.15.73:0/4261689738 learned_addr learned my addr 172.21.15.73:0/4261689738 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.512+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000012218 0 0) 0x7fb0200014b0 con 0x7fb02813f350 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): my global_id is 134363 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb014003550 con 0x7fb02813f350 2024-09-11T02:03:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022243027 0 0) 0x7fb0280a18d0 con 0x7fb0280a72f0 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): my global_id is 6165 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0200014b0 con 0x7fb0280a72f0 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 221431124 0 0) 0x7fb014003550 con 0x7fb02813f350 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0280a18d0 con 0x7fb02813f350 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb020001f20 con 0x7fb02813f350 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): dump: 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1173300237 0 0) 0x7fb0200014b0 con 0x7fb0280a72f0 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb014003550 con 0x7fb0280a72f0 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb018001710 con 0x7fb0280a72f0 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient(hunting): dump: 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4105410807 0 0) 0x7fb0280a18d0 con 0x7fb02813f350 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 >> v1:172.21.15.203:6791/0 conn(0x7fb028138d40 legacy=0x7fb02813a0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 >> v1:172.21.15.73:6789/0 conn(0x7fb0280a72f0 legacy=0x7fb0281399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 monclient: found mon.b 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02813c9b0 con 0x7fb02813f350 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb02e833640 5 monclient: authenticate success, global_id 134363 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb02e833640 10 monclient: _renew_subs 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb02e833640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb02813c110 con 0x7fb02813f350 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb02e833640 10 monclient: _renew_subs 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb02e833640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb0280a10c0 con 0x7fb02813f350 2024-09-11T02:03:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb020004e10 con 0x7fb02813f350 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb020005300 con 0x7fb02813f350 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb0267fc640 4 set_mon_vals no callback set 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.513+0000 7fb024ff9640 10 monclient: dump: 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb02e833640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb0080065c0 con 0x7fb008002860 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fb020011a40 con 0x7fb02813f350 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(220..220 src has 1..220) ==== 3506+0+0 (unknown 2193691034 0 0) 0x7fb02004e560 con 0x7fb02813f350 2024-09-11T02:03:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb0277fe640 10 monclient: get_auth_request con 0x7fb014040250 auth_method 0 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023130462 0 0) 0x7fb0080065c0 con 0x7fb008002860 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb024ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb024ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb024ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb024ff9640 10 monclient(hunting): my global_id is 6024 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.514+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0280a18d0 con 0x7fb008002860 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3343307335 0 0) 0x7fb0280a18d0 con 0x7fb008002860 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0080065c0 con 0x7fb008002860 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb018004c40 con 0x7fb008002860 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 10 monclient: dump: 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.539 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3749076803 0 0) 0x7fb0080065c0 con 0x7fb008002860 2024-09-11T02:03:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.203:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb00800a160 con 0x7fb008002860 2024-09-11T02:03:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb018001c60 con 0x7fb008002860 2024-09-11T02:03:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:03:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 >> v1:172.21.15.203:6790/0 conn(0x7fb008002860 legacy=0x7fb008004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.515+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 >> v1:172.21.15.203:6790/0 conn(0x7fb008002860 legacy=0x7fb008004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.521+0000 7fb02e833640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.521+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb008009e70 con 0x7fb008009130 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726916046 0 0) 0x7fb008009e70 con 0x7fb008009130 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 10 monclient(hunting): my global_id is 6033 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0080065c0 con 0x7fb008009130 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 394117856 0 0) 0x7fb0080065c0 con 0x7fb008009130 2024-09-11T02:03:15.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb008009e70 con 0x7fb008009130 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb018005820 con 0x7fb008009130 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 10 monclient: dump: 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1883552230 0 0) 0x7fb008009e70 con 0x7fb008009130 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 --> v1:172.21.15.203:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb00800c410 con 0x7fb008009130 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7689 (unknown 0 0 2875754774) 0x7fb018007ca0 con 0x7fb008009130 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 >> v1:172.21.15.203:6790/0 conn(0x7fb008009130 legacy=0x7fb0080095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.522+0000 7fb024ff9640 1 -- 172.21.15.73:0/4261689738 >> v1:172.21.15.203:6790/0 conn(0x7fb008009130 legacy=0x7fb0080095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 46, 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 317959, 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:03:15.545 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.546 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.547 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:03:15.548 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.549 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:03:15.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.551 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.552 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.553 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.554 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.555 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.556 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.557 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.558 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.559 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.560 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.561 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.562 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.563 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:03:15.564 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:03:15.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 >> v1:172.21.15.203:6812/2311533528 conn(0x7fb014040250 legacy=0x7fb014042710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02e833640 10 monclient: shutdown 2024-09-11T02:03:15.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02e833640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 >> v1:172.21.15.73:6790/0 conn(0x7fb02813f350 legacy=0x7fb0281d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02cdd0640 1 -- 172.21.15.73:0/4261689738 reap_dead start 2024-09-11T02:03:15.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02cdd0640 1 -- 172.21.15.73:0/4261689738 reap_dead start 2024-09-11T02:03:15.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 shutdown_connections 2024-09-11T02:03:15.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 >> 172.21.15.73:0/4261689738 conn(0x7fb0280a8050 msgr2=0x7fb02813ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 shutdown_connections 2024-09-11T02:03:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.523+0000 7fb02e833640 1 -- 172.21.15.73:0/4261689738 wait complete. 2024-09-11T02:03:15.567 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T02:03:15.567 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon i 2024-09-11T02:03:15.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.663+0000 7fe34fde2640 10 monclient: get_monmap_and_config 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.663+0000 7fe34fde2640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.663+0000 7fe34fde2640 10 monclient: monmap: 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:03:15.664259+0000 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:03:15.664259+0000 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.665 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.666 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.666 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.666 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.666 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.666 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.666 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.666 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.663+0000 7fe34fde2640 1 Processor -- start 2024-09-11T02:03:15.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 1 -- start start 2024-09-11T02:03:15.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 10 monclient: init 2024-09-11T02:03:15.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 10 monclient: _add_conns ranks=[5,3,8,4,2,1,7,0,6] 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 10 monclient(hunting): picked mon.noname-h con 0x7fe3480a5b30 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 10 monclient(hunting): picked mon.noname-g con 0x7fe3480a6620 addr v1:172.21.15.203:6790/0 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 10 monclient(hunting): picked mon.noname-e con 0x7fe34809db70 addr v1:172.21.15.73:6793/0 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3480a7490 con 0x7fe3480a6620 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34809ca00 con 0x7fe3480a5b30 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34806fbf0 con 0x7fe34809db70 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34fde2640 10 monclient(hunting): authenticate will time out at 1037.268739s 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34db7e640 1 -- >> v1:172.21.15.203:6791/0 conn(0x7fe3480a5b30 legacy=0x7fe3480a5f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34e37f640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fe34809db70 0x7fe348141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:44344/0 (socket says 172.21.15.73:44344) 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.664+0000 7fe34e37f640 1 -- 172.21.15.73:0/2316348718 learned_addr learned my addr 172.21.15.73:0/2316348718 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 -- 172.21.15.73:0/2316348718 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993829068 0 0) 0x7fe34806fbf0 con 0x7fe34809db70 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient(hunting): my global_id is 115127 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 -- 172.21.15.73:0/2316348718 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe334003520 con 0x7fe34809db70 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 -- 172.21.15.73:0/2316348718 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 458737285 0 0) 0x7fe334003520 con 0x7fe34809db70 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 -- 172.21.15.73:0/2316348718 >> v1:172.21.15.203:6791/0 conn(0x7fe3480a5b30 legacy=0x7fe3480a5f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 -- 172.21.15.73:0/2316348718 >> v1:172.21.15.203:6790/0 conn(0x7fe3480a6620 legacy=0x7fe34813dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 monclient: found mon.noname-e 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 -- 172.21.15.73:0/2316348718 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34809ceb0 con 0x7fe34809db70 2024-09-11T02:03:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 -- 172.21.15.73:0/2316348718 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe340001bd0 con 0x7fe34809db70 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 5 monclient: authenticate success, global_id 115127 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: dump: 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.677 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 -- 172.21.15.73:0/2316348718 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe340001df0 con 0x7fe34809db70 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 10 monclient: get_monmap_and_config success 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 1 -- 172.21.15.73:0/2316348718 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe340004f60 con 0x7fe34809db70 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 4 set_mon_vals no callback set 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34cb7c640 10 monclient: dump: 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 10 monclient: shutdown 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 1 -- 172.21.15.73:0/2316348718 >> v1:172.21.15.73:6793/0 conn(0x7fe34809db70 legacy=0x7fe348141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 1 -- 172.21.15.73:0/2316348718 shutdown_connections 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.665+0000 7fe34fde2640 1 -- 172.21.15.73:0/2316348718 >> 172.21.15.73:0/2316348718 conn(0x7fe3480abe30 msgr2=0x7fe3480a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.666+0000 7fe34fde2640 1 -- 172.21.15.73:0/2316348718 shutdown_connections 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.666+0000 7fe34fde2640 1 -- 172.21.15.73:0/2316348718 wait complete. 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.666+0000 7fe34fde2640 10 monclient: build_initial_monmap 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.666+0000 7fe34fde2640 10 monclient: monmap: 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:03:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.666+0000 7fe34fde2640 1 Processor -- start 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.666+0000 7fe34fde2640 1 -- start start 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.666+0000 7fe34fde2640 10 monclient: init 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 10 monclient: _reopen_session rank -1 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 10 monclient: _add_conns ranks=[8,5,7,6,4,0,3,1,2] 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 10 monclient(hunting): picked mon.noname-e con 0x7fe3480a5b30 addr v1:172.21.15.73:6793/0 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 10 monclient(hunting): picked mon.noname-h con 0x7fe3480a6620 addr v1:172.21.15.203:6791/0 2024-09-11T02:03:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 10 monclient(hunting): picked mon.noname-i con 0x7fe348127560 addr v1:172.21.15.203:6792/0 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe348126a00 con 0x7fe3480a6620 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3481263a0 con 0x7fe348127560 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe348141b10 con 0x7fe3480a5b30 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 10 monclient(hunting): _renew_subs 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34fde2640 10 monclient(hunting): authenticate will time out at 1037.271419s 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34d37d640 1 -- >> v1:172.21.15.203:6791/0 conn(0x7fe3480a6620 legacy=0x7fe348141400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.203:6791/0 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34db7e640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fe3480a5b30 0x7fe3481cd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:44358/0 (socket says 172.21.15.73:44358) 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe34db7e640 1 -- 172.21.15.73:0/1661675818 learned_addr learned my addr 172.21.15.73:0/1661675818 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456996775 0 0) 0x7fe348141b10 con 0x7fe3480a5b30 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): my global_id is 115136 2024-09-11T02:03:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe32c003520 con 0x7fe3480a5b30 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551609673 0 0) 0x7fe3481263a0 con 0x7fe348127560 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): my global_id is 5956 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe348141b10 con 0x7fe348127560 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 844795046 0 0) 0x7fe32c003520 con 0x7fe3480a5b30 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3481263a0 con 0x7fe3480a5b30 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe33c0043a0 con 0x7fe3480a5b30 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): dump: 2024-09-11T02:03:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.667+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1944792264 0 0) 0x7fe348141b10 con 0x7fe348127560 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe32c003520 con 0x7fe348127560 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe340004ea0 con 0x7fe348127560 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient(hunting): dump: 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4220527219 0 0) 0x7fe3481263a0 con 0x7fe3480a5b30 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 >> v1:172.21.15.203:6792/0 conn(0x7fe348127560 legacy=0x7fe3481d5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 >> v1:172.21.15.203:6791/0 conn(0x7fe3480a6620 legacy=0x7fe348141400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T02:03:15.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 1 monclient: found mon.e 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3481d9bc0 con 0x7fe3480a5b30 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient: _finish_auth 0 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe34fde2640 5 monclient: authenticate success, global_id 115136 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe34fde2640 10 monclient: _renew_subs 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe34fde2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3481d6b90 con 0x7fe3480a5b30 2024-09-11T02:03:15.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe34fde2640 10 monclient: _renew_subs 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe34fde2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3481d7150 con 0x7fe3480a5b30 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe33c0045c0 con 0x7fe3480a5b30 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe33c004bf0 con 0x7fe3480a5b30 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33bfff640 4 set_mon_vals no callback set 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe33a7fc640 10 monclient: dump: 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe34fde2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.668+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe3300065c0 con 0x7fe330002860 2024-09-11T02:03:15.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fe33c004e10 con 0x7fe3480a5b30 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(220..220 src has 1..220) ==== 3506+0+0 (unknown 2193691034 0 0) 0x7fe33c04e290 con 0x7fe3480a5b30 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24024109 0 0) 0x7fe3300065c0 con 0x7fe330002860 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 10 monclient(hunting): my global_id is 5965 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3481263a0 con 0x7fe330002860 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe34e37f640 10 monclient: get_auth_request con 0x7fe32c040240 auth_method 0 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4238128643 0 0) 0x7fe3481263a0 con 0x7fe330002860 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3300065c0 con 0x7fe330002860 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe3440017b0 con 0x7fe330002860 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 10 monclient: dump: 2024-09-11T02:03:15.691 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.693 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2243014118 0 0) 0x7fe3300065c0 con 0x7fe330002860 2024-09-11T02:03:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.669+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe33000a160 con 0x7fe330002860 2024-09-11T02:03:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.670+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe344001c10 con 0x7fe330002860 2024-09-11T02:03:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.670+0000 7fe33a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:03:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.670+0000 7fe33a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:03:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.670+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 >> v1:172.21.15.203:6792/0 conn(0x7fe330002860 legacy=0x7fe330004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.670+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 >> v1:172.21.15.203:6792/0 conn(0x7fe330002860 legacy=0x7fe330004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe34fde2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe330009e70 con 0x7fe330009130 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1704820431 0 0) 0x7fe330009e70 con 0x7fe330009130 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 10 monclient(hunting): my global_id is 5974 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3300065c0 con 0x7fe330009130 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1073112121 0 0) 0x7fe3300065c0 con 0x7fe330009130 2024-09-11T02:03:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe330009e70 con 0x7fe330009130 2024-09-11T02:03:15.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fe344003c60 con 0x7fe330009130 2024-09-11T02:03:15.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:03:15.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:03:15.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 10 monclient: dump: 2024-09-11T02:03:15.696 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:03:15.696 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:03:15.696 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.696 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:03:15.696 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1629434500 0 0) 0x7fe330009e70 con 0x7fe330009130 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.676+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 --> v1:172.21.15.203:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe33000c410 con 0x7fe330009130 2024-09-11T02:03:15.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7689 (unknown 0 0 1675379361) 0x7fe3440057c0 con 0x7fe330009130 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe33a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe33a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 >> v1:172.21.15.203:6792/0 conn(0x7fe330009130 legacy=0x7fe3300095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe33a7fc640 1 -- 172.21.15.73:0/1661675818 >> v1:172.21.15.203:6792/0 conn(0x7fe330009130 legacy=0x7fe3300095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 46, 2024-09-11T02:03:15.698 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 318097, 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:03:15.699 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:03:15.700 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:03:15.702 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:03:15.703 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.704 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:03:15.705 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.706 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.707 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:03:15.710 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.711 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.713 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.714 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:03:15.715 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.716 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.717 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:03:15.718 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:03:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:03:15.719 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:03:15.719 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:03:15.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 >> v1:172.21.15.203:6812/2311533528 conn(0x7fe32c040240 legacy=0x7fe32c042700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34fde2640 10 monclient: shutdown 2024-09-11T02:03:15.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34fde2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:03:15.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 >> v1:172.21.15.73:6793/0 conn(0x7fe3480a5b30 legacy=0x7fe3481cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:03:15.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34e37f640 1 -- 172.21.15.73:0/1661675818 reap_dead start 2024-09-11T02:03:15.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34e37f640 1 -- 172.21.15.73:0/1661675818 reap_dead start 2024-09-11T02:03:15.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 shutdown_connections 2024-09-11T02:03:15.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 >> 172.21.15.73:0/1661675818 conn(0x7fe34809db70 msgr2=0x7fe348142400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:03:15.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 shutdown_connections 2024-09-11T02:03:15.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:03:15.677+0000 7fe34fde2640 1 -- 172.21.15.73:0/1661675818 wait complete. 2024-09-11T02:03:15.721 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-09-11T02:03:15.721 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-09-11T02:03:17.509 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38385]: starting. 2024-09-11T02:03:17.510 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38385]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38384 2024-09-11T02:03:17.510 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38385]: created object 0... 2024-09-11T02:03:17.510 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38385]: created object 25... 2024-09-11T02:03:17.510 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38385]: created object 49... 2024-09-11T02:03:17.510 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38385]: finishing. 2024-09-11T02:03:17.510 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38385]: shutting down. 2024-09-11T02:03:17.605 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38386]: starting. 2024-09-11T02:03:17.605 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38386]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38384 2024-09-11T02:03:17.605 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38386]: shutting down. 2024-09-11T02:03:19.703 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:19.703 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38419]: starting. 2024-09-11T02:03:19.704 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38419]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38384 2024-09-11T02:03:19.704 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38419]: created object 0... 2024-09-11T02:03:19.704 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38419]: created object 25... 2024-09-11T02:03:19.704 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38419]: created object 49... 2024-09-11T02:03:19.704 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38419]: finishing. 2024-09-11T02:03:19.704 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38419]: shutting down. 2024-09-11T02:03:19.714 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:19.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38421]: starting. 2024-09-11T02:03:19.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38421]: listing objects. 2024-09-11T02:03:19.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38421]: listed object 0... 2024-09-11T02:03:19.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38421]: listed object 25... 2024-09-11T02:03:19.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38421]: saw 50 objects 2024-09-11T02:03:19.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38421]: shutting down. 2024-09-11T02:03:20.629 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:20.629 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38420]: starting. 2024-09-11T02:03:20.630 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38420]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38384 2024-09-11T02:03:20.630 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38420]: shutting down. 2024-09-11T02:03:20.631 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:20.631 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:20.631 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:03:20.634 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:03:22.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38488]: starting. 2024-09-11T02:03:22.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38488]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38487 2024-09-11T02:03:22.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38488]: created object 0... 2024-09-11T02:03:22.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38488]: created object 25... 2024-09-11T02:03:22.733 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38488]: created object 49... 2024-09-11T02:03:22.734 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38488]: finishing. 2024-09-11T02:03:22.734 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38488]: shutting down. 2024-09-11T02:03:23.665 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38489]: starting. 2024-09-11T02:03:23.665 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38489]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38487 2024-09-11T02:03:23.665 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38489]: shutting down. 2024-09-11T02:03:25.754 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:25.754 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38522]: starting. 2024-09-11T02:03:25.754 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38522]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38487 2024-09-11T02:03:25.754 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38522]: created object 0... 2024-09-11T02:03:25.754 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38522]: created object 25... 2024-09-11T02:03:25.754 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38522]: created object 49... 2024-09-11T02:03:25.754 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38522]: finishing. 2024-09-11T02:03:25.754 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38522]: shutting down. 2024-09-11T02:03:25.764 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:25.765 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38524]: starting. 2024-09-11T02:03:25.765 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38524]: listing objects. 2024-09-11T02:03:25.765 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38524]: listed object 0... 2024-09-11T02:03:25.765 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38524]: listed object 25... 2024-09-11T02:03:25.765 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38524]: saw 50 objects 2024-09-11T02:03:25.765 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38524]: shutting down. 2024-09-11T02:03:26.680 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:26.680 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38523]: starting. 2024-09-11T02:03:26.680 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38523]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38487 2024-09-11T02:03:26.680 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38523]: shutting down. 2024-09-11T02:03:26.681 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:26.682 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:26.682 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:03:26.685 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:03:28.694 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38591]: starting. 2024-09-11T02:03:28.694 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38591]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38590 2024-09-11T02:03:28.694 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38591]: created object 0... 2024-09-11T02:03:28.694 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38591]: created object 25... 2024-09-11T02:03:28.695 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38591]: created object 49... 2024-09-11T02:03:28.695 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38591]: finishing. 2024-09-11T02:03:28.695 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38591]: shutting down. 2024-09-11T02:03:29.615 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38592]: starting. 2024-09-11T02:03:29.615 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38592]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38590 2024-09-11T02:03:29.615 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38592]: shutting down. 2024-09-11T02:03:31.729 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:31.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38626]: starting. 2024-09-11T02:03:31.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38626]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38590 2024-09-11T02:03:31.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38626]: created object 0... 2024-09-11T02:03:31.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38626]: created object 25... 2024-09-11T02:03:31.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38626]: created object 49... 2024-09-11T02:03:31.729 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38626]: finishing. 2024-09-11T02:03:31.730 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38626]: shutting down. 2024-09-11T02:03:31.739 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:31.739 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38628]: starting. 2024-09-11T02:03:31.739 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38628]: listing objects. 2024-09-11T02:03:31.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38628]: listed object 0... 2024-09-11T02:03:31.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38628]: listed object 25... 2024-09-11T02:03:31.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38628]: saw 50 objects 2024-09-11T02:03:31.740 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38628]: shutting down. 2024-09-11T02:03:32.637 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:32.637 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38627]: starting. 2024-09-11T02:03:32.637 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38627]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38590 2024-09-11T02:03:32.637 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38627]: shutting down. 2024-09-11T02:03:32.638 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:32.638 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:32.639 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:03:32.641 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:03:34.752 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38695]: starting. 2024-09-11T02:03:34.753 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38695]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38694 2024-09-11T02:03:34.753 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38695]: created object 0... 2024-09-11T02:03:34.753 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38695]: created object 25... 2024-09-11T02:03:34.753 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38695]: created object 49... 2024-09-11T02:03:34.753 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38695]: finishing. 2024-09-11T02:03:34.753 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38695]: shutting down. 2024-09-11T02:03:35.668 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38696]: starting. 2024-09-11T02:03:35.668 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38696]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38694 2024-09-11T02:03:35.668 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38696]: shutting down. 2024-09-11T02:03:37.707 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:37.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38729]: starting. 2024-09-11T02:03:37.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38729]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38694 2024-09-11T02:03:37.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38729]: created object 0... 2024-09-11T02:03:37.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38729]: created object 25... 2024-09-11T02:03:37.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38729]: created object 49... 2024-09-11T02:03:37.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38729]: finishing. 2024-09-11T02:03:37.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38729]: shutting down. 2024-09-11T02:03:37.719 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:37.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38731]: starting. 2024-09-11T02:03:37.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38731]: listing objects. 2024-09-11T02:03:37.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38731]: listed object 0... 2024-09-11T02:03:37.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38731]: listed object 25... 2024-09-11T02:03:37.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38731]: saw 50 objects 2024-09-11T02:03:37.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38731]: shutting down. 2024-09-11T02:03:38.613 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:38.613 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38730]: starting. 2024-09-11T02:03:38.614 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38730]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38694 2024-09-11T02:03:38.614 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38730]: shutting down. 2024-09-11T02:03:38.615 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:38.615 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:38.615 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:03:38.617 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:03:40.708 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38798]: starting. 2024-09-11T02:03:40.708 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38798]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38797 2024-09-11T02:03:40.708 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38798]: created object 0... 2024-09-11T02:03:40.708 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38798]: created object 25... 2024-09-11T02:03:40.708 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38798]: created object 49... 2024-09-11T02:03:40.708 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38798]: finishing. 2024-09-11T02:03:40.708 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38798]: shutting down. 2024-09-11T02:03:41.617 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38799]: starting. 2024-09-11T02:03:41.617 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38799]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38797 2024-09-11T02:03:41.617 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38799]: shutting down. 2024-09-11T02:03:43.730 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:43.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38832]: starting. 2024-09-11T02:03:43.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38832]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38797 2024-09-11T02:03:43.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38832]: created object 0... 2024-09-11T02:03:43.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38832]: created object 25... 2024-09-11T02:03:43.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38832]: created object 49... 2024-09-11T02:03:43.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38832]: finishing. 2024-09-11T02:03:43.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38832]: shutting down. 2024-09-11T02:03:43.741 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:43.741 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38834]: starting. 2024-09-11T02:03:43.742 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38834]: listing objects. 2024-09-11T02:03:43.742 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38834]: listed object 0... 2024-09-11T02:03:43.742 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38834]: listed object 25... 2024-09-11T02:03:43.742 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38834]: saw 50 objects 2024-09-11T02:03:43.742 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38834]: shutting down. 2024-09-11T02:03:44.659 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:44.659 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38833]: starting. 2024-09-11T02:03:44.660 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38833]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38797 2024-09-11T02:03:44.660 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38833]: shutting down. 2024-09-11T02:03:44.661 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:44.661 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:44.661 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:03:44.663 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:03:46.774 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38902]: starting. 2024-09-11T02:03:46.775 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38902]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38901 2024-09-11T02:03:46.775 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38902]: created object 0... 2024-09-11T02:03:46.775 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38902]: created object 25... 2024-09-11T02:03:46.775 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38902]: created object 49... 2024-09-11T02:03:46.775 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38902]: finishing. 2024-09-11T02:03:46.775 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[38902]: shutting down. 2024-09-11T02:03:47.696 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38903]: starting. 2024-09-11T02:03:47.697 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38903]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38901 2024-09-11T02:03:47.697 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[38903]: shutting down. 2024-09-11T02:03:49.788 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38937]: starting. 2024-09-11T02:03:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38937]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-38901 2024-09-11T02:03:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38937]: created object 0... 2024-09-11T02:03:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38937]: created object 25... 2024-09-11T02:03:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38937]: created object 49... 2024-09-11T02:03:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38937]: finishing. 2024-09-11T02:03:49.789 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[38937]: shutting down. 2024-09-11T02:03:49.799 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:49.799 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38939]: starting. 2024-09-11T02:03:49.799 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38939]: listing objects. 2024-09-11T02:03:49.799 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38939]: listed object 0... 2024-09-11T02:03:49.799 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38939]: listed object 25... 2024-09-11T02:03:49.799 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38939]: saw 50 objects 2024-09-11T02:03:49.799 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[38939]: shutting down. 2024-09-11T02:03:50.716 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:50.716 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38938]: starting. 2024-09-11T02:03:50.716 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38938]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-38901 2024-09-11T02:03:50.716 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[38938]: shutting down. 2024-09-11T02:03:50.717 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:50.717 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:50.717 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:03:50.720 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:03:52.820 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39009]: starting. 2024-09-11T02:03:52.821 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39009]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39008 2024-09-11T02:03:52.821 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39009]: created object 0... 2024-09-11T02:03:52.821 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39009]: created object 25... 2024-09-11T02:03:52.821 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39009]: created object 49... 2024-09-11T02:03:52.821 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39009]: finishing. 2024-09-11T02:03:52.821 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39009]: shutting down. 2024-09-11T02:03:53.745 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39010]: starting. 2024-09-11T02:03:53.745 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39010]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39008 2024-09-11T02:03:53.745 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39010]: shutting down. 2024-09-11T02:03:55.875 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:55.876 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39043]: starting. 2024-09-11T02:03:55.876 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39043]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39008 2024-09-11T02:03:55.876 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39043]: created object 0... 2024-09-11T02:03:55.876 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39043]: created object 25... 2024-09-11T02:03:55.876 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39043]: created object 49... 2024-09-11T02:03:55.876 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39043]: finishing. 2024-09-11T02:03:55.876 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39043]: shutting down. 2024-09-11T02:03:55.887 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:55.887 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39045]: starting. 2024-09-11T02:03:55.887 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39045]: listing objects. 2024-09-11T02:03:55.887 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39045]: listed object 0... 2024-09-11T02:03:55.887 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39045]: listed object 25... 2024-09-11T02:03:55.887 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39045]: saw 50 objects 2024-09-11T02:03:55.887 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39045]: shutting down. 2024-09-11T02:03:56.782 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:56.782 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39044]: starting. 2024-09-11T02:03:56.782 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39044]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39008 2024-09-11T02:03:56.782 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39044]: shutting down. 2024-09-11T02:03:56.784 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:56.784 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:03:56.784 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:03:56.787 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:03:58.718 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39113]: starting. 2024-09-11T02:03:58.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39113]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39112 2024-09-11T02:03:58.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39113]: created object 0... 2024-09-11T02:03:58.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39113]: created object 25... 2024-09-11T02:03:58.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39113]: created object 49... 2024-09-11T02:03:58.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39113]: finishing. 2024-09-11T02:03:58.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39113]: shutting down. 2024-09-11T02:03:59.627 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39114]: starting. 2024-09-11T02:03:59.628 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39114]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39112 2024-09-11T02:03:59.628 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39114]: shutting down. 2024-09-11T02:04:01.711 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:01.711 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39147]: starting. 2024-09-11T02:04:01.711 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39147]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39112 2024-09-11T02:04:01.711 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39147]: created object 0... 2024-09-11T02:04:01.711 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39147]: created object 25... 2024-09-11T02:04:01.711 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39147]: created object 49... 2024-09-11T02:04:01.712 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39147]: finishing. 2024-09-11T02:04:01.712 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39147]: shutting down. 2024-09-11T02:04:01.721 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:01.721 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39149]: starting. 2024-09-11T02:04:01.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39149]: listing objects. 2024-09-11T02:04:01.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39149]: listed object 0... 2024-09-11T02:04:01.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39149]: listed object 25... 2024-09-11T02:04:01.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39149]: saw 50 objects 2024-09-11T02:04:01.722 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39149]: shutting down. 2024-09-11T02:04:02.642 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:02.642 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39148]: starting. 2024-09-11T02:04:02.642 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39148]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39112 2024-09-11T02:04:02.642 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39148]: shutting down. 2024-09-11T02:04:02.643 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:02.644 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:02.644 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:04:02.647 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:04:04.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39216]: starting. 2024-09-11T02:04:04.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39216]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39215 2024-09-11T02:04:04.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39216]: created object 0... 2024-09-11T02:04:04.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39216]: created object 25... 2024-09-11T02:04:04.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39216]: created object 49... 2024-09-11T02:04:04.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39216]: finishing. 2024-09-11T02:04:04.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39216]: shutting down. 2024-09-11T02:04:05.684 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39217]: starting. 2024-09-11T02:04:05.684 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39217]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39215 2024-09-11T02:04:05.684 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39217]: shutting down. 2024-09-11T02:04:07.716 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:07.716 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39250]: starting. 2024-09-11T02:04:07.716 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39250]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39215 2024-09-11T02:04:07.716 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39250]: created object 0... 2024-09-11T02:04:07.716 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39250]: created object 25... 2024-09-11T02:04:07.716 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39250]: created object 49... 2024-09-11T02:04:07.716 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39250]: finishing. 2024-09-11T02:04:07.717 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39250]: shutting down. 2024-09-11T02:04:07.726 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:07.726 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39252]: starting. 2024-09-11T02:04:07.726 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39252]: listing objects. 2024-09-11T02:04:07.727 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39252]: listed object 0... 2024-09-11T02:04:07.727 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39252]: listed object 25... 2024-09-11T02:04:07.727 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39252]: saw 50 objects 2024-09-11T02:04:07.727 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39252]: shutting down. 2024-09-11T02:04:08.625 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:08.625 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39251]: starting. 2024-09-11T02:04:08.625 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39251]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39215 2024-09-11T02:04:08.625 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39251]: shutting down. 2024-09-11T02:04:08.626 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:08.627 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:08.627 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:04:08.630 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:04:10.781 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39319]: starting. 2024-09-11T02:04:10.781 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39319]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39318 2024-09-11T02:04:10.781 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39319]: created object 0... 2024-09-11T02:04:10.781 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39319]: created object 25... 2024-09-11T02:04:10.782 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39319]: created object 49... 2024-09-11T02:04:10.782 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39319]: finishing. 2024-09-11T02:04:10.782 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39319]: shutting down. 2024-09-11T02:04:11.705 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39320]: starting. 2024-09-11T02:04:11.705 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39320]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39318 2024-09-11T02:04:11.705 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39320]: shutting down. 2024-09-11T02:04:13.791 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:13.791 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39353]: starting. 2024-09-11T02:04:13.791 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39353]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39318 2024-09-11T02:04:13.791 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39353]: created object 0... 2024-09-11T02:04:13.791 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39353]: created object 25... 2024-09-11T02:04:13.791 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39353]: created object 49... 2024-09-11T02:04:13.791 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39353]: finishing. 2024-09-11T02:04:13.791 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39353]: shutting down. 2024-09-11T02:04:13.803 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:13.803 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39355]: starting. 2024-09-11T02:04:13.803 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39355]: listing objects. 2024-09-11T02:04:13.803 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39355]: listed object 0... 2024-09-11T02:04:13.803 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39355]: listed object 25... 2024-09-11T02:04:13.803 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39355]: saw 50 objects 2024-09-11T02:04:13.803 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39355]: shutting down. 2024-09-11T02:04:14.728 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:14.728 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39354]: starting. 2024-09-11T02:04:14.728 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39354]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39318 2024-09-11T02:04:14.728 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39354]: shutting down. 2024-09-11T02:04:14.730 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:14.730 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:14.730 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:04:14.733 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:04:16.826 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39422]: starting. 2024-09-11T02:04:16.827 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39422]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39421 2024-09-11T02:04:16.827 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39422]: created object 0... 2024-09-11T02:04:16.827 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39422]: created object 25... 2024-09-11T02:04:16.827 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39422]: created object 49... 2024-09-11T02:04:16.827 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39422]: finishing. 2024-09-11T02:04:16.827 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39422]: shutting down. 2024-09-11T02:04:17.625 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39423]: starting. 2024-09-11T02:04:17.625 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39423]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39421 2024-09-11T02:04:17.625 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39423]: shutting down. 2024-09-11T02:04:19.719 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:19.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39456]: starting. 2024-09-11T02:04:19.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39456]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39421 2024-09-11T02:04:19.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39456]: created object 0... 2024-09-11T02:04:19.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39456]: created object 25... 2024-09-11T02:04:19.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39456]: created object 49... 2024-09-11T02:04:19.719 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39456]: finishing. 2024-09-11T02:04:19.720 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39456]: shutting down. 2024-09-11T02:04:19.731 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:19.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39458]: starting. 2024-09-11T02:04:19.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39458]: listing objects. 2024-09-11T02:04:19.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39458]: listed object 0... 2024-09-11T02:04:19.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39458]: listed object 25... 2024-09-11T02:04:19.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39458]: saw 50 objects 2024-09-11T02:04:19.731 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39458]: shutting down. 2024-09-11T02:04:20.629 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:20.629 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39457]: starting. 2024-09-11T02:04:20.629 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39457]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39421 2024-09-11T02:04:20.630 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39457]: shutting down. 2024-09-11T02:04:20.630 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:20.630 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:20.631 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:04:20.634 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:04:22.741 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39525]: starting. 2024-09-11T02:04:22.741 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39525]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39524 2024-09-11T02:04:22.741 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39525]: created object 0... 2024-09-11T02:04:22.741 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39525]: created object 25... 2024-09-11T02:04:22.741 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39525]: created object 49... 2024-09-11T02:04:22.741 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39525]: finishing. 2024-09-11T02:04:22.741 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39525]: shutting down. 2024-09-11T02:04:23.660 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39526]: starting. 2024-09-11T02:04:23.660 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39526]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39524 2024-09-11T02:04:23.660 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39526]: shutting down. 2024-09-11T02:04:25.752 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:25.752 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39559]: starting. 2024-09-11T02:04:25.752 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39559]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39524 2024-09-11T02:04:25.752 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39559]: created object 0... 2024-09-11T02:04:25.752 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39559]: created object 25... 2024-09-11T02:04:25.752 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39559]: created object 49... 2024-09-11T02:04:25.753 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39559]: finishing. 2024-09-11T02:04:25.753 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39559]: shutting down. 2024-09-11T02:04:25.763 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:25.763 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39561]: starting. 2024-09-11T02:04:25.763 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39561]: listing objects. 2024-09-11T02:04:25.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39561]: listed object 0... 2024-09-11T02:04:25.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39561]: listed object 25... 2024-09-11T02:04:25.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39561]: saw 50 objects 2024-09-11T02:04:25.764 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39561]: shutting down. 2024-09-11T02:04:26.672 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:26.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39560]: starting. 2024-09-11T02:04:26.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39560]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39524 2024-09-11T02:04:26.672 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39560]: shutting down. 2024-09-11T02:04:26.675 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:26.675 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:26.675 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:04:26.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:04:28.714 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39628]: starting. 2024-09-11T02:04:28.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39628]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39627 2024-09-11T02:04:28.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39628]: created object 0... 2024-09-11T02:04:28.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39628]: created object 25... 2024-09-11T02:04:28.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39628]: created object 49... 2024-09-11T02:04:28.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39628]: finishing. 2024-09-11T02:04:28.715 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39628]: shutting down. 2024-09-11T02:04:29.630 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39629]: starting. 2024-09-11T02:04:29.630 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39629]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39627 2024-09-11T02:04:29.630 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39629]: shutting down. 2024-09-11T02:04:31.736 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:31.737 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39662]: starting. 2024-09-11T02:04:31.737 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39662]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39627 2024-09-11T02:04:31.737 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39662]: created object 0... 2024-09-11T02:04:31.737 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39662]: created object 25... 2024-09-11T02:04:31.737 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39662]: created object 49... 2024-09-11T02:04:31.737 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39662]: finishing. 2024-09-11T02:04:31.737 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39662]: shutting down. 2024-09-11T02:04:31.747 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:31.747 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39664]: starting. 2024-09-11T02:04:31.747 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39664]: listing objects. 2024-09-11T02:04:31.747 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39664]: listed object 0... 2024-09-11T02:04:31.747 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39664]: listed object 25... 2024-09-11T02:04:31.747 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39664]: saw 50 objects 2024-09-11T02:04:31.748 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39664]: shutting down. 2024-09-11T02:04:32.655 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:32.655 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39663]: starting. 2024-09-11T02:04:32.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39663]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39627 2024-09-11T02:04:32.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39663]: shutting down. 2024-09-11T02:04:32.657 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:32.657 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:32.657 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:04:32.660 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:04:34.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39731]: starting. 2024-09-11T02:04:34.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39731]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39730 2024-09-11T02:04:34.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39731]: created object 0... 2024-09-11T02:04:34.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39731]: created object 25... 2024-09-11T02:04:34.757 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39731]: created object 49... 2024-09-11T02:04:34.758 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39731]: finishing. 2024-09-11T02:04:34.758 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39731]: shutting down. 2024-09-11T02:04:35.686 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39732]: starting. 2024-09-11T02:04:35.686 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39732]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39730 2024-09-11T02:04:35.686 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39732]: shutting down. 2024-09-11T02:04:37.713 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:37.713 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39765]: starting. 2024-09-11T02:04:37.713 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39765]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39730 2024-09-11T02:04:37.713 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39765]: created object 0... 2024-09-11T02:04:37.713 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39765]: created object 25... 2024-09-11T02:04:37.713 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39765]: created object 49... 2024-09-11T02:04:37.713 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39765]: finishing. 2024-09-11T02:04:37.713 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39765]: shutting down. 2024-09-11T02:04:37.724 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:37.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39767]: starting. 2024-09-11T02:04:37.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39767]: listing objects. 2024-09-11T02:04:37.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39767]: listed object 0... 2024-09-11T02:04:37.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39767]: listed object 25... 2024-09-11T02:04:37.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39767]: saw 50 objects 2024-09-11T02:04:37.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39767]: shutting down. 2024-09-11T02:04:38.635 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:38.635 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39766]: starting. 2024-09-11T02:04:38.635 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39766]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39730 2024-09-11T02:04:38.635 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39766]: shutting down. 2024-09-11T02:04:38.636 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:38.636 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:38.637 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:04:38.640 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:04:40.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39834]: starting. 2024-09-11T02:04:40.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39834]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39833 2024-09-11T02:04:40.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39834]: created object 0... 2024-09-11T02:04:40.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39834]: created object 25... 2024-09-11T02:04:40.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39834]: created object 49... 2024-09-11T02:04:40.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39834]: finishing. 2024-09-11T02:04:40.724 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39834]: shutting down. 2024-09-11T02:04:41.650 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39835]: starting. 2024-09-11T02:04:41.650 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39835]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39833 2024-09-11T02:04:41.650 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39835]: shutting down. 2024-09-11T02:04:43.745 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:43.745 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39868]: starting. 2024-09-11T02:04:43.745 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39868]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39833 2024-09-11T02:04:43.745 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39868]: created object 0... 2024-09-11T02:04:43.745 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39868]: created object 25... 2024-09-11T02:04:43.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39868]: created object 49... 2024-09-11T02:04:43.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39868]: finishing. 2024-09-11T02:04:43.746 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[39868]: shutting down. 2024-09-11T02:04:43.755 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:43.755 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39870]: starting. 2024-09-11T02:04:43.755 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39870]: listing objects. 2024-09-11T02:04:43.755 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39870]: listed object 0... 2024-09-11T02:04:43.755 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39870]: listed object 25... 2024-09-11T02:04:43.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39870]: saw 50 objects 2024-09-11T02:04:43.756 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[39870]: shutting down. 2024-09-11T02:04:44.656 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:44.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39869]: starting. 2024-09-11T02:04:44.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39869]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39833 2024-09-11T02:04:44.656 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[39869]: shutting down. 2024-09-11T02:04:44.658 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:44.658 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:44.658 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:04:44.661 DEBUG:teuthology.orchestra.run.smithi203:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-11T02:04:45.722 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-09-11T02:04:45.722 INFO:tasks.ceph.mon.f:Restarting daemon 2024-09-11T02:04:45.722 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-09-11T02:04:45.725 INFO:tasks.ceph.mon.f:Started 2024-09-11T02:04:45.725 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2024-09-11T02:04:45.725 INFO:tasks.ceph.mon.h:Restarting daemon 2024-09-11T02:04:45.725 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-09-11T02:04:45.727 INFO:tasks.ceph.mon.h:Started 2024-09-11T02:04:45.727 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-11T02:04:45.728 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-11T02:04:45.728 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T02:04:56.960 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39937]: starting. 2024-09-11T02:04:56.961 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39937]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39936 2024-09-11T02:04:56.961 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39937]: created object 0... 2024-09-11T02:04:56.961 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39937]: created object 25... 2024-09-11T02:04:56.961 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39937]: created object 49... 2024-09-11T02:04:56.961 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39937]: finishing. 2024-09-11T02:04:56.961 INFO:teuthology.orchestra.run.smithi203.stdout:process_1_[39937]: shutting down. 2024-09-11T02:04:57.629 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39938]: starting. 2024-09-11T02:04:57.629 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39938]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39936 2024-09-11T02:04:57.629 INFO:teuthology.orchestra.run.smithi203.stdout:process_2_[39938]: shutting down. 2024-09-11T02:04:59.748 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:59.748 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[40087]: starting. 2024-09-11T02:04:59.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[40087]: creating pool ceph_test_rados_delete_pools_parallel.smithi203-39936 2024-09-11T02:04:59.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[40087]: created object 0... 2024-09-11T02:04:59.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[40087]: created object 25... 2024-09-11T02:04:59.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[40087]: created object 49... 2024-09-11T02:04:59.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[40087]: finishing. 2024-09-11T02:04:59.749 INFO:teuthology.orchestra.run.smithi203.stdout:process_3_[40087]: shutting down. 2024-09-11T02:04:59.759 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:04:59.759 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[40089]: starting. 2024-09-11T02:04:59.759 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[40089]: listing objects. 2024-09-11T02:04:59.759 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[40089]: listed object 0... 2024-09-11T02:04:59.759 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[40089]: listed object 25... 2024-09-11T02:04:59.759 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[40089]: saw 50 objects 2024-09-11T02:04:59.759 INFO:teuthology.orchestra.run.smithi203.stdout:process_5_[40089]: shutting down. 2024-09-11T02:05:00.654 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:05:00.654 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[40088]: starting. 2024-09-11T02:05:00.654 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[40088]: deleting pool ceph_test_rados_delete_pools_parallel.smithi203-39936 2024-09-11T02:05:00.655 INFO:teuthology.orchestra.run.smithi203.stdout:process_4_[40088]: shutting down. 2024-09-11T02:05:00.656 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:05:00.656 INFO:teuthology.orchestra.run.smithi203.stdout:******************************* 2024-09-11T02:05:00.656 INFO:teuthology.orchestra.run.smithi203.stdout:******* SUCCESS ********** 2024-09-11T02:05:00.659 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-11T02:05:00.668 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-11T02:05:00.729 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-11T02:05:00.729 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-11T02:05:00.729 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-11T02:05:00.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:05:00.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.836+0000 7f4ac7794640 10 monclient: get_monmap_and_config 2024-09-11T02:05:00.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.836+0000 7f4ac7794640 10 monclient: build_initial_monmap 2024-09-11T02:05:00.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.836+0000 7f4ac7794640 10 monclient: monmap: 2024-09-11T02:05:00.837 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:00.837 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:00.836936+0000 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:00.836936+0000 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:00.838 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:00.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.836+0000 7f4ac7794640 1 Processor -- start 2024-09-11T02:05:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.836+0000 7f4ac7794640 1 -- start start 2024-09-11T02:05:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.836+0000 7f4ac7794640 10 monclient: init 2024-09-11T02:05:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 10 monclient: _add_conns ranks=[6,5,8,1,4,0,7,2,3] 2024-09-11T02:05:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 10 monclient(hunting): picked mon.noname-d con 0x7f4ac0138960 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 10 monclient(hunting): picked mon.noname-h con 0x7f4ac0139450 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 10 monclient(hunting): picked mon.noname-e con 0x7f4ac013f620 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac009d030 con 0x7f4ac0139450 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac009d310 con 0x7f4ac0138960 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac006f770 con 0x7f4ac013f620 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac7794640 10 monclient(hunting): authenticate will time out at 1142.441402s 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac5d31640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f4ac013f620 0x7f4ac0141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:37102/0 (socket says 172.21.15.73:37102) 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac5530640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f4ac0138960 0x7f4ac0138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:37432/0 (socket says 172.21.15.73:37432) 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4ac5d31640 1 -- 172.21.15.73:0/3710718631 learned_addr learned my addr 172.21.15.73:0/3710718631 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105888064 0 0) 0x7f4ac006f770 con 0x7f4ac013f620 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): my global_id is 115631 2024-09-11T02:05:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aa8003520 con 0x7f4ac013f620 2024-09-11T02:05:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3176412755 0 0) 0x7f4ac009d310 con 0x7f4ac0138960 2024-09-11T02:05:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): my global_id is 115620 2024-09-11T02:05:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ac006f770 con 0x7f4ac0138960 2024-09-11T02:05:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656813720 0 0) 0x7f4ac009d030 con 0x7f4ac0139450 2024-09-11T02:05:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 10 monclient(hunting): my global_id is 144104 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ac009d310 con 0x7f4ac0139450 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 523858964 0 0) 0x7f4aa8003520 con 0x7f4ac013f620 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.837+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 >> v1:172.21.15.73:6792/0 conn(0x7f4ac0138960 legacy=0x7f4ac0138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 >> v1:172.21.15.203:6791/0 conn(0x7f4ac0139450 legacy=0x7f4ac013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: _finish_hunting 0 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 1 monclient: found mon.noname-e 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac00a7360 con 0x7f4ac013f620 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: _finish_auth 0 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: _check_auth_tickets 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4ab8001830 con 0x7f4ac013f620 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: dump: 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:00.851 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 5 monclient: authenticate success, global_id 115631 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ab80019d0 con 0x7f4ac013f620 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 1 -- 172.21.15.73:0/3710718631 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4ab8004be0 con 0x7f4ac013f620 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 4 set_mon_vals no callback set 2024-09-11T02:05:00.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4abffff640 10 monclient: dump: 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:00.853 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 10 monclient: shutdown 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 1 -- 172.21.15.73:0/3710718631 >> v1:172.21.15.73:6793/0 conn(0x7f4ac013f620 legacy=0x7f4ac0141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 1 -- 172.21.15.73:0/3710718631 shutdown_connections 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 1 -- 172.21.15.73:0/3710718631 >> 172.21.15.73:0/3710718631 conn(0x7f4ac00a8050 msgr2=0x7f4ac00a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 1 -- 172.21.15.73:0/3710718631 shutdown_connections 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.838+0000 7f4ac7794640 1 -- 172.21.15.73:0/3710718631 wait complete. 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.839+0000 7f4ac7794640 10 monclient: build_initial_monmap 2024-09-11T02:05:00.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.839+0000 7f4ac7794640 10 monclient: monmap: 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:00.855 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.839+0000 7f4ac7794640 1 Processor -- start 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.839+0000 7f4ac7794640 1 -- start start 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.839+0000 7f4ac7794640 10 monclient: init 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 10 monclient: _add_conns ranks=[1,0,7,3,4,6,5,8,2] 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 10 monclient(hunting): picked mon.noname-f con 0x7f4ac0138960 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 10 monclient(hunting): picked mon.noname-a con 0x7f4ac0139450 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 10 monclient(hunting): picked mon.noname-i con 0x7f4ac013f620 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac013c250 con 0x7f4ac0139450 2024-09-11T02:05:00.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac00a1cf0 con 0x7f4ac0138960 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac013ef90 con 0x7f4ac013f620 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 10 monclient(hunting): authenticate will time out at 1142.444115s 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac4d2f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4ac0139450 0x7f4ac01d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54556/0 (socket says 172.21.15.73:54556) 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac4d2f640 1 -- 172.21.15.73:0/2567991854 learned_addr learned my addr 172.21.15.73:0/2567991854 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059219540 0 0) 0x7f4ac009d310 con 0x7f4ac0139450 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): my global_id is 6651 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aac003520 con 0x7f4ac0139450 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224347152 0 0) 0x7f4ac013ef90 con 0x7f4ac013f620 2024-09-11T02:05:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): my global_id is 6496 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ac009d310 con 0x7f4ac013f620 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 845500436 0 0) 0x7f4ac00a1cf0 con 0x7f4ac0138960 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): my global_id is 144100 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ac013ef90 con 0x7f4ac0138960 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2522963388 0 0) 0x7f4aac003520 con 0x7f4ac0139450 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ac00a1cf0 con 0x7f4ac0139450 2024-09-11T02:05:00.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4ab4001bb0 con 0x7f4ac0139450 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): dump: 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:00.859 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2601513688 0 0) 0x7f4ac009d310 con 0x7f4ac013f620 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4aac003520 con 0x7f4ac013f620 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4ab8001770 con 0x7f4ac013f620 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient(hunting): dump: 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:00.860 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 354578785 0 0) 0x7f4ac013ef90 con 0x7f4ac0138960 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ac009d310 con 0x7f4ac0138960 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 605000628 0 0) 0x7f4ac00a1cf0 con 0x7f4ac0139450 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 >> v1:172.21.15.203:6792/0 conn(0x7f4ac013f620 legacy=0x7f4ac01d5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 >> v1:172.21.15.203:6789/0 conn(0x7f4ac0138960 legacy=0x7f4ac013e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient: _finish_hunting 0 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 monclient: found mon.a 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac013c530 con 0x7f4ac0139450 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient: _finish_auth 0 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 10 monclient: _check_auth_tickets 2024-09-11T02:05:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4abdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 5 monclient: authenticate success, global_id 6651 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 10 monclient: _renew_subs 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.840+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac013b2f0 con 0x7f4ac0139450 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ab40038c0 con 0x7f4ac0139450 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4abdffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4ab4003e30 con 0x7f4ac0139450 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4abdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4abdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4abdffb640 10 monclient: dump: 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.863 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4abf7fe640 4 set_mon_vals no callback set 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4ac7794640 10 monclient: _renew_subs 2024-09-11T02:05:00.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4ac7794640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:00.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4ac013e730 con 0x7f4ac0139450 2024-09-11T02:05:00.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.841+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f4ab4003fd0 con 0x7f4ac0139450 2024-09-11T02:05:00.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.842+0000 7f4ac7794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:00.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.842+0000 7f4ac7794640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:00.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.842+0000 7f4ac7794640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:00.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.842+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac0074820 con 0x7f4ac0139450 2024-09-11T02:05:00.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.842+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7f4ab404e320 con 0x7f4ac0139450 2024-09-11T02:05:00.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.842+0000 7f4ac5530640 10 monclient: get_auth_request con 0x7f4aac0404e0 auth_method 0 2024-09-11T02:05:00.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.846+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f4ac013c250 con 0x7f4ac0139450 2024-09-11T02:05:00.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.846+0000 7f4abdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:00.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:00.846+0000 7f4abdffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.091+0000 7f4ac7794640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:05:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.091+0000 7f4ac7794640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:05:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.091+0000 7f4ac7794640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.091+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4ac013ea20 con 0x7f4ac0139450 2024-09-11T02:05:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.091+0000 7f4abdffb640 1 -- 172.21.15.73:0/2567991854 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 3953675181) 0x7f4ab40175a0 con 0x7f4ac0139450 2024-09-11T02:05:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.091+0000 7f4abdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:05:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.091+0000 7f4abdffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:01.093 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":52,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:05:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.093+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 >> v1:172.21.15.203:6812/2311533528 conn(0x7f4aac0404e0 legacy=0x7f4aac0429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.093+0000 7f4ac7794640 10 monclient: shutdown 2024-09-11T02:05:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.093+0000 7f4ac7794640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.093+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 >> v1:172.21.15.73:6789/0 conn(0x7f4ac0139450 legacy=0x7f4ac01d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.093+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 shutdown_connections 2024-09-11T02:05:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.093+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 >> 172.21.15.73:0/2567991854 conn(0x7f4ac00a8050 msgr2=0x7f4ac00a8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.093+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 shutdown_connections 2024-09-11T02:05:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.093+0000 7f4ac7794640 1 -- 172.21.15.73:0/2567991854 wait complete. 2024-09-11T02:05:01.105 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-11T02:05:01.105 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-11T02:05:01.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T02:05:01.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.202+0000 7f92399db640 10 monclient: get_monmap_and_config 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.202+0000 7f92399db640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.202+0000 7f92399db640 10 monclient: monmap: 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:01.203150+0000 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:01.203150+0000 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.205 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.205 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.202+0000 7f92399db640 1 Processor -- start 2024-09-11T02:05:01.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.202+0000 7f92399db640 1 -- start start 2024-09-11T02:05:01.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.202+0000 7f92399db640 10 monclient: init 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 10 monclient: _add_conns ranks=[5,7,0,6,2,3,4,1,8] 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 10 monclient(hunting): picked mon.noname-h con 0x7f9234138960 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 10 monclient(hunting): picked mon.noname-i con 0x7f9234139450 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 10 monclient(hunting): picked mon.noname-a con 0x7f923413f620 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923409d030 con 0x7f923413f620 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923409d310 con 0x7f9234138960 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923406f770 con 0x7f9234139450 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92399db640 10 monclient(hunting): authenticate will time out at 1142.807463s 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92337fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f923413f620 0x7f9234141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60292/0 (socket says 172.21.15.73:60292) 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f92337fe640 1 -- 172.21.15.73:0/2340169670 learned_addr learned my addr 172.21.15.73:0/2340169670 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 1 -- 172.21.15.73:0/2340169670 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413192396 0 0) 0x7f923409d030 con 0x7f923413f620 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 10 monclient(hunting): my global_id is 6660 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 1 -- 172.21.15.73:0/2340169670 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f921c003520 con 0x7f923413f620 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 1 -- 172.21.15.73:0/2340169670 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3520833558 0 0) 0x7f921c003520 con 0x7f923413f620 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 1 -- 172.21.15.73:0/2340169670 >> v1:172.21.15.203:6792/0 conn(0x7f9234139450 legacy=0x7f923413df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 1 -- 172.21.15.73:0/2340169670 >> v1:172.21.15.203:6791/0 conn(0x7f9234138960 legacy=0x7f9234138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 1 monclient: found mon.noname-a 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:05:01.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 1 -- 172.21.15.73:0/2340169670 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92340a7360 con 0x7f923413f620 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 5 monclient: authenticate success, global_id 6660 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.203+0000 7f9231ffb640 1 -- 172.21.15.73:0/2340169670 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9224001bb0 con 0x7f923413f620 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f9231ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f9231ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f9231ffb640 10 monclient: dump: 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.215 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:01.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f9231ffb640 1 -- 172.21.15.73:0/2340169670 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9224001dd0 con 0x7f923413f620 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f9231ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f9231ffb640 1 -- 172.21.15.73:0/2340169670 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9224004f60 con 0x7f923413f620 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 4 set_mon_vals no callback set 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f9231ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f9231ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f9231ffb640 10 monclient: dump: 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.217 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 10 monclient: shutdown 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 1 -- 172.21.15.73:0/2340169670 >> v1:172.21.15.73:6789/0 conn(0x7f923413f620 legacy=0x7f9234141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 1 -- 172.21.15.73:0/2340169670 shutdown_connections 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 1 -- 172.21.15.73:0/2340169670 >> 172.21.15.73:0/2340169670 conn(0x7f92340a8050 msgr2=0x7f92340a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 1 -- 172.21.15.73:0/2340169670 shutdown_connections 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.204+0000 7f92399db640 1 -- 172.21.15.73:0/2340169670 wait complete. 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.205+0000 7f92399db640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.205+0000 7f92399db640 10 monclient: monmap: 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.219 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.205+0000 7f92399db640 1 Processor -- start 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.205+0000 7f92399db640 1 -- start start 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.205+0000 7f92399db640 10 monclient: init 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient: _add_conns ranks=[1,3,4,6,5,8,7,2,0] 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient(hunting): picked mon.noname-f con 0x7f9234138960 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:01.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient(hunting): picked mon.noname-g con 0x7f9234139450 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient(hunting): picked mon.noname-c con 0x7f923413f620 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9234142890 con 0x7f9234138960 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923413b5a0 con 0x7f9234139450 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923406e680 con 0x7f923413f620 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient(hunting): authenticate will time out at 1142.810265s 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92337fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f923413f620 0x7f92341d5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40294/0 (socket says 172.21.15.73:40294) 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92337fe640 1 -- 172.21.15.73:0/2008630291 learned_addr learned my addr 172.21.15.73:0/2008630291 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173102272 0 0) 0x7f923406e680 con 0x7f923413f620 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): my global_id is 6358 2024-09-11T02:05:01.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9220003520 con 0x7f923413f620 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1594425897 0 0) 0x7f9234142890 con 0x7f9234138960 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): my global_id is 144109 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f923406e680 con 0x7f9234138960 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 359566109 0 0) 0x7f9220003520 con 0x7f923413f620 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9234142890 con 0x7f923413f620 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9224001f80 con 0x7f923413f620 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): dump: 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.223 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3925075325 0 0) 0x7f923413b5a0 con 0x7f9234139450 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient(hunting): my global_id is 6510 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9220003520 con 0x7f9234139450 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3203119335 0 0) 0x7f9234142890 con 0x7f923413f620 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 >> v1:172.21.15.203:6790/0 conn(0x7f9234139450 legacy=0x7f92341d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 >> v1:172.21.15.203:6789/0 conn(0x7f9234138960 legacy=0x7f923413e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 monclient: found mon.c 2024-09-11T02:05:01.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923413c500 con 0x7f923413f620 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f921bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 5 monclient: authenticate success, global_id 6358 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient: _renew_subs 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f923413c840 con 0x7f923413f620 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient: _renew_subs 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.206+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f923413a1e0 con 0x7f923413f620 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9224001c90 con 0x7f923413f620 2024-09-11T02:05:01.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f921bfff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9224001590 con 0x7f923413f620 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f921bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f92317fa640 4 set_mon_vals no callback set 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f921bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f921bfff640 10 monclient: dump: 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.226 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f92399db640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f92140065c0 con 0x7f9214002860 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.207+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9224011a30 con 0x7f923413f620 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7f922404e650 con 0x7f923413f620 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834806725 0 0) 0x7f92140065c0 con 0x7f9214002860 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 10 monclient(hunting): my global_id is 6669 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9234142890 con 0x7f9214002860 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f92327fc640 10 monclient: get_auth_request con 0x7f922003ff30 auth_method 0 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1606670667 0 0) 0x7f9234142890 con 0x7f9214002860 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92140065c0 con 0x7f9214002860 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f922c001970 con 0x7f9214002860 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 10 monclient: dump: 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.229 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 148832477 0 0) 0x7f92140065c0 con 0x7f9214002860 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f921400a160 con 0x7f9214002860 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f922c004640 con 0x7f9214002860 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 >> v1:172.21.15.73:6789/0 conn(0x7f9214002860 legacy=0x7f9214004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.208+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 >> v1:172.21.15.73:6789/0 conn(0x7f9214002860 legacy=0x7f9214004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.214+0000 7f92399db640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9214009e70 con 0x7f9214009130 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457421044 0 0) 0x7f9214009e70 con 0x7f9214009130 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 10 monclient(hunting): my global_id is 6678 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92140065c0 con 0x7f9214009130 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3406172949 0 0) 0x7f92140065c0 con 0x7f9214009130 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9214009e70 con 0x7f9214009130 2024-09-11T02:05:01.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f922c003c40 con 0x7f9214009130 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 10 monclient: dump: 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.233 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1622738682 0 0) 0x7f9214009e70 con 0x7f9214009130 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 --> v1:172.21.15.73:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f921400c410 con 0x7f9214009130 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 <== mon.0 v1:172.21.15.73:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 412259968) 0x7f922c003e20 con 0x7f9214009130 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 >> v1:172.21.15.73:6789/0 conn(0x7f9214009130 legacy=0x7f92140095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.215+0000 7f921bfff640 1 -- 172.21.15.73:0/2008630291 >> v1:172.21.15.73:6789/0 conn(0x7f9214009130 legacy=0x7f92140095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 52, 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 423655, 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:05:01.235 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.237 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:05:01.238 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.239 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:01.240 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.241 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.242 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.244 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.245 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.247 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.249 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.250 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:01.251 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.252 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:01.253 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:01.254 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.255 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.255 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.255 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:05:01.255 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 >> v1:172.21.15.203:6812/2311533528 conn(0x7f922003ff30 legacy=0x7f92200423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92399db640 10 monclient: shutdown 2024-09-11T02:05:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92399db640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 >> v1:172.21.15.73:6791/0 conn(0x7f923413f620 legacy=0x7f92341d5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92337fe640 1 -- 172.21.15.73:0/2008630291 reap_dead start 2024-09-11T02:05:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92337fe640 1 -- 172.21.15.73:0/2008630291 reap_dead start 2024-09-11T02:05:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 shutdown_connections 2024-09-11T02:05:01.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 >> 172.21.15.73:0/2008630291 conn(0x7f92340a8050 msgr2=0x7f92340a1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 shutdown_connections 2024-09-11T02:05:01.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.216+0000 7f92399db640 1 -- 172.21.15.73:0/2008630291 wait complete. 2024-09-11T02:05:01.257 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:05:01.257 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-11T02:05:01.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T02:05:01.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.354+0000 7f1aba8be640 10 monclient: get_monmap_and_config 2024-09-11T02:05:01.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.354+0000 7f1aba8be640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.354+0000 7f1aba8be640 10 monclient: monmap: 2024-09-11T02:05:01.356 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.356 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.356 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:01.355483+0000 2024-09-11T02:05:01.356 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:01.355483+0000 2024-09-11T02:05:01.356 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.356 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.357 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.355+0000 7f1aba8be640 1 Processor -- start 2024-09-11T02:05:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.355+0000 7f1aba8be640 1 -- start start 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.355+0000 7f1aba8be640 10 monclient: init 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.355+0000 7f1aba8be640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.355+0000 7f1aba8be640 10 monclient: _add_conns ranks=[3,2,5,8,4,0,7,1,6] 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.355+0000 7f1aba8be640 10 monclient(hunting): picked mon.noname-g con 0x7f1ab40688e0 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.355+0000 7f1aba8be640 10 monclient(hunting): picked mon.noname-b con 0x7f1ab40693d0 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.355+0000 7f1aba8be640 10 monclient(hunting): picked mon.noname-h con 0x7f1ab40697e0 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1aba8be640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab40749e0 con 0x7f1ab40693d0 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1aba8be640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab409cf20 con 0x7f1ab40688e0 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1aba8be640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab409d200 con 0x7f1ab40697e0 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1aba8be640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1aba8be640 10 monclient(hunting): authenticate will time out at 1142.960054s 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab37fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f1ab40693d0 0x7f1ab413de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41724/0 (socket says 172.21.15.73:41724) 2024-09-11T02:05:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab37fe640 1 -- 172.21.15.73:0/3891436944 learned_addr learned my addr 172.21.15.73:0/3891436944 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942842959 0 0) 0x7f1ab40749e0 con 0x7f1ab40693d0 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): my global_id is 134795 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a9c003520 con 0x7f1ab40693d0 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936613322 0 0) 0x7f1ab409d200 con 0x7f1ab40697e0 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): my global_id is 144122 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab40749e0 con 0x7f1ab40697e0 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087042744 0 0) 0x7f1ab409cf20 con 0x7f1ab40688e0 2024-09-11T02:05:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient(hunting): my global_id is 6519 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab409d200 con 0x7f1ab40688e0 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3075607629 0 0) 0x7f1a9c003520 con 0x7f1ab40693d0 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 >> v1:172.21.15.203:6791/0 conn(0x7f1ab40697e0 legacy=0x7f1ab4141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 >> v1:172.21.15.203:6790/0 conn(0x7f1ab40688e0 legacy=0x7f1ab4068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 monclient: found mon.noname-b 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab40744c0 con 0x7f1ab40693d0 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1aa80017b0 con 0x7f1ab40693d0 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: dump: 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.374 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1aba8be640 5 monclient: authenticate success, global_id 134795 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1aba8be640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1aa8001950 con 0x7f1ab40693d0 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1aba8be640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 1 -- 172.21.15.73:0/3891436944 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1aa8004be0 con 0x7f1ab40693d0 2024-09-11T02:05:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1aba8be640 4 set_mon_vals no callback set 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.356+0000 7f1ab2ffd640 10 monclient: dump: 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.376 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.357+0000 7f1aba8be640 10 monclient: shutdown 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.357+0000 7f1aba8be640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.357+0000 7f1aba8be640 1 -- 172.21.15.73:0/3891436944 >> v1:172.21.15.73:6790/0 conn(0x7f1ab40693d0 legacy=0x7f1ab413de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.357+0000 7f1aba8be640 1 -- 172.21.15.73:0/3891436944 shutdown_connections 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.357+0000 7f1aba8be640 1 -- 172.21.15.73:0/3891436944 >> 172.21.15.73:0/3891436944 conn(0x7f1ab40a7200 msgr2=0x7f1ab40a7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.357+0000 7f1aba8be640 1 -- 172.21.15.73:0/3891436944 shutdown_connections 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.357+0000 7f1aba8be640 1 -- 172.21.15.73:0/3891436944 wait complete. 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.357+0000 7f1aba8be640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.357+0000 7f1aba8be640 10 monclient: monmap: 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.378 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 1 Processor -- start 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 1 -- start start 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 10 monclient: init 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 10 monclient: _add_conns ranks=[1,2,4,6,3,8,0,5,7] 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 10 monclient(hunting): picked mon.noname-f con 0x7f1ab40688e0 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 10 monclient(hunting): picked mon.noname-b con 0x7f1ab40693d0 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 10 monclient(hunting): picked mon.noname-c con 0x7f1ab40697e0 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab40a0560 con 0x7f1ab40688e0 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab413c990 con 0x7f1ab40693d0 2024-09-11T02:05:01.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab413adc0 con 0x7f1ab40697e0 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1aba8be640 10 monclient(hunting): authenticate will time out at 1142.962833s 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1ab37fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f1ab40693d0 0x7f1ab413a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41732/0 (socket says 172.21.15.73:41732) 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.358+0000 7f1ab37fe640 1 -- 172.21.15.73:0/3925456008 learned_addr learned my addr 172.21.15.73:0/3925456008 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145214943 0 0) 0x7f1ab413c990 con 0x7f1ab40693d0 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): my global_id is 134804 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aa0003520 con 0x7f1ab40693d0 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895861110 0 0) 0x7f1ab413adc0 con 0x7f1ab40697e0 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): my global_id is 6367 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab413c990 con 0x7f1ab40697e0 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224395369 0 0) 0x7f1ab409d200 con 0x7f1ab40688e0 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): my global_id is 144118 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab413adc0 con 0x7f1ab40688e0 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2193185837 0 0) 0x7f1aa0003520 con 0x7f1ab40693d0 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ab409d200 con 0x7f1ab40693d0 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1aa80017b0 con 0x7f1ab40693d0 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): dump: 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.382 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1489248424 0 0) 0x7f1ab413c990 con 0x7f1ab40697e0 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1aa0003520 con 0x7f1ab40697e0 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2911493900 0 0) 0x7f1ab413adc0 con 0x7f1ab40688e0 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ab413c990 con 0x7f1ab40688e0 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1aac001cf0 con 0x7f1ab40697e0 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): dump: 2024-09-11T02:05:01.383 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.384 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1aa40019d0 con 0x7f1ab40688e0 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient(hunting): dump: 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.385 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 514828996 0 0) 0x7f1ab409d200 con 0x7f1ab40693d0 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 >> v1:172.21.15.73:6791/0 conn(0x7f1ab40697e0 legacy=0x7f1ab41d5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 >> v1:172.21.15.203:6789/0 conn(0x7f1ab40688e0 legacy=0x7f1ab4139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 monclient: found mon.b 2024-09-11T02:05:01.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab40a0010 con 0x7f1ab40693d0 2024-09-11T02:05:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1aba8be640 5 monclient: authenticate success, global_id 134804 2024-09-11T02:05:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1aba8be640 10 monclient: _renew_subs 2024-09-11T02:05:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1aba8be640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:01.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab40a48b0 con 0x7f1ab40693d0 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1aba8be640 10 monclient: _renew_subs 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1aba8be640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1ab413b840 con 0x7f1ab40693d0 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1aa8001950 con 0x7f1ab40693d0 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1aa8004bd0 con 0x7f1ab40693d0 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab27fc640 4 set_mon_vals no callback set 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.359+0000 7f1ab0ff9640 10 monclient: dump: 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.388 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1aba8be640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1a940065c0 con 0x7f1a94002860 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1125191016 0 0) 0x7f1a940065c0 con 0x7f1a94002860 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1ab0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1ab0ff9640 10 monclient(hunting): my global_id is 134813 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab409d200 con 0x7f1a94002860 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f1aa8011780 con 0x7f1ab40693d0 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.360+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7f1aa804e290 con 0x7f1ab40693d0 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3638192799 0 0) 0x7f1ab409d200 con 0x7f1a94002860 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a940065c0 con 0x7f1a94002860 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1aa4003930 con 0x7f1a94002860 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:01.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 10 monclient: dump: 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.391 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab8e5b640 10 monclient: get_auth_request con 0x7f1aa0040600 auth_method 0 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 513577533 0 0) 0x7f1a940065c0 con 0x7f1a94002860 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a9400a160 con 0x7f1a94002860 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1aa4003a60 con 0x7f1a94002860 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 >> v1:172.21.15.73:6790/0 conn(0x7f1a94002860 legacy=0x7f1a94004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.361+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 >> v1:172.21.15.73:6790/0 conn(0x7f1a94002860 legacy=0x7f1a94004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.367+0000 7f1aba8be640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.367+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1a94009e70 con 0x7f1a94009130 2024-09-11T02:05:01.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.367+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3101453425 0 0) 0x7f1a94009e70 con 0x7f1a94009130 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.367+0000 7f1ab0ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.367+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.367+0000 7f1ab0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.367+0000 7f1ab0ff9640 10 monclient(hunting): my global_id is 134822 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.367+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a940065c0 con 0x7f1a94009130 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3407334141 0 0) 0x7f1a940065c0 con 0x7f1a94009130 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a94009e70 con 0x7f1a94009130 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1aa40042d0 con 0x7f1a94009130 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 10 monclient: dump: 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.393 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.394 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 564971744 0 0) 0x7f1a94009e70 con 0x7f1a94009130 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 --> v1:172.21.15.73:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a9400c3f0 con 0x7f1a94009130 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 <== mon.2 v1:172.21.15.73:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3975493703) 0x7f1aa4006590 con 0x7f1a94009130 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 >> v1:172.21.15.73:6790/0 conn(0x7f1a94009130 legacy=0x7f1a940095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab0ff9640 1 -- 172.21.15.73:0/3925456008 >> v1:172.21.15.73:6790/0 conn(0x7f1a94009130 legacy=0x7f1a940095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:01.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 52, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 137070, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:05:01.396 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.397 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.398 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.399 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.400 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:01.401 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.402 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.404 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.407 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:05:01.408 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.409 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.411 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:05:01.412 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:05:01.413 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.414 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:05:01.415 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:01.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 >> v1:172.21.15.203:6812/2311533528 conn(0x7f1aa0040600 legacy=0x7f1aa0042ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1aba8be640 10 monclient: shutdown 2024-09-11T02:05:01.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1aba8be640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 >> v1:172.21.15.73:6790/0 conn(0x7f1ab40693d0 legacy=0x7f1ab413a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab8e5b640 1 -- 172.21.15.73:0/3925456008 reap_dead start 2024-09-11T02:05:01.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1ab8e5b640 1 -- 172.21.15.73:0/3925456008 reap_dead start 2024-09-11T02:05:01.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 shutdown_connections 2024-09-11T02:05:01.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.368+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 >> 172.21.15.73:0/3925456008 conn(0x7f1ab40a7200 msgr2=0x7f1ab4132cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.369+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 shutdown_connections 2024-09-11T02:05:01.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.369+0000 7f1aba8be640 1 -- 172.21.15.73:0/3925456008 wait complete. 2024-09-11T02:05:01.417 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:05:01.417 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-11T02:05:01.417 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T02:05:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.515+0000 7f536ad91640 10 monclient: get_monmap_and_config 2024-09-11T02:05:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.515+0000 7f536ad91640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.515+0000 7f536ad91640 10 monclient: monmap: 2024-09-11T02:05:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.517 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:01.516774+0000 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:01.516774+0000 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.518 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.516+0000 7f536ad91640 1 Processor -- start 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.516+0000 7f536ad91640 1 -- start start 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.516+0000 7f536ad91640 10 monclient: init 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 10 monclient: _add_conns ranks=[5,7,4,3,0,1,6,8,2] 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 10 monclient(hunting): picked mon.noname-h con 0x7f5364138d40 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 10 monclient(hunting): picked mon.noname-i con 0x7f53640a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 10 monclient(hunting): picked mon.noname-c con 0x7f536413f350 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f536409ca00 con 0x7f536413f350 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53640a7070 con 0x7f5364138d40 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f536409cee0 con 0x7f53640a72f0 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 10 monclient(hunting): authenticate will time out at 1143.121279s 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536932e640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f536413f350 0x7f5364141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40298/0 (socket says 172.21.15.73:40298) 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536932e640 1 -- 172.21.15.73:0/3135932750 learned_addr learned my addr 172.21.15.73:0/3135932750 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665100456 0 0) 0x7f536409ca00 con 0x7f536413f350 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): my global_id is 6376 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5350003520 con 0x7f536413f350 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154591187 0 0) 0x7f536409cee0 con 0x7f53640a72f0 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): my global_id is 6514 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f536409ca00 con 0x7f53640a72f0 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034751808 0 0) 0x7f53640a7070 con 0x7f5364138d40 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient(hunting): my global_id is 144131 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f536409cee0 con 0x7f5364138d40 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1331455524 0 0) 0x7f5350003520 con 0x7f536413f350 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 >> v1:172.21.15.203:6792/0 conn(0x7f53640a72f0 legacy=0x7f536413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 >> v1:172.21.15.203:6791/0 conn(0x7f5364138d40 legacy=0x7f5364139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 monclient: found mon.noname-c 2024-09-11T02:05:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:05:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536409d1c0 con 0x7f536413f350 2024-09-11T02:05:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f535c001bd0 con 0x7f536413f350 2024-09-11T02:05:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 5 monclient: authenticate success, global_id 6376 2024-09-11T02:05:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: dump: 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f535c001d70 con 0x7f536413f350 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 1 -- 172.21.15.73:0/3135932750 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f535c004f60 con 0x7f536413f350 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f536ad91640 4 set_mon_vals no callback set 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.517+0000 7f53637fe640 10 monclient: dump: 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.518+0000 7f536ad91640 10 monclient: shutdown 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.518+0000 7f536ad91640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.518+0000 7f536ad91640 1 -- 172.21.15.73:0/3135932750 >> v1:172.21.15.73:6791/0 conn(0x7f536413f350 legacy=0x7f5364141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.518+0000 7f536ad91640 1 -- 172.21.15.73:0/3135932750 shutdown_connections 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.518+0000 7f536ad91640 1 -- 172.21.15.73:0/3135932750 >> 172.21.15.73:0/3135932750 conn(0x7f53640a8050 msgr2=0x7f53640a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.518+0000 7f536ad91640 1 -- 172.21.15.73:0/3135932750 shutdown_connections 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.518+0000 7f536ad91640 1 -- 172.21.15.73:0/3135932750 wait complete. 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 10 monclient: monmap: 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 1 Processor -- start 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 1 -- start start 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 10 monclient: init 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 10 monclient: _add_conns ranks=[8,6,3,7,5,4,0,1,2] 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 10 monclient(hunting): picked mon.noname-e con 0x7f53640a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 10 monclient(hunting): picked mon.noname-d con 0x7f5364138d40 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 10 monclient(hunting): picked mon.noname-g con 0x7f536413f350 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f536413a800 con 0x7f536413f350 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.519+0000 7f536ad91640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53640a53e0 con 0x7f5364138d40 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f536413ac80 con 0x7f53640a72f0 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 10 monclient(hunting): authenticate will time out at 1143.124012s 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f5368b2d640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f53640a72f0 0x7f53641399e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35080/0 (socket says 172.21.15.73:35080) 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f5368b2d640 1 -- 172.21.15.73:0/884923576 learned_addr learned my addr 172.21.15.73:0/884923576 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761009750 0 0) 0x7f536413ac80 con 0x7f53640a72f0 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): my global_id is 115640 2024-09-11T02:05:01.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5344003550 con 0x7f53640a72f0 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453240818 0 0) 0x7f53640a53e0 con 0x7f5364138d40 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): my global_id is 115629 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f536413ac80 con 0x7f5364138d40 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3112095672 0 0) 0x7f536413a800 con 0x7f536413f350 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): my global_id is 6528 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53640a53e0 con 0x7f536413f350 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 497902481 0 0) 0x7f5344003550 con 0x7f53640a72f0 2024-09-11T02:05:01.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f536413a800 con 0x7f53640a72f0 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5354001bb0 con 0x7f53640a72f0 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): dump: 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2933237733 0 0) 0x7f536413ac80 con 0x7f5364138d40 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5344003550 con 0x7f5364138d40 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f534c001980 con 0x7f5364138d40 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:01.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient(hunting): dump: 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2284938548 0 0) 0x7f536413a800 con 0x7f53640a72f0 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 >> v1:172.21.15.73:6792/0 conn(0x7f5364138d40 legacy=0x7f536413a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 >> v1:172.21.15.203:6790/0 conn(0x7f536413f350 legacy=0x7f53641d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 monclient: found mon.e 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536413cfe0 con 0x7f53640a72f0 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 5 monclient: authenticate success, global_id 115640 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 10 monclient: _renew_subs 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f536413c740 con 0x7f53640a72f0 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 10 monclient: _renew_subs 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f536413ba50 con 0x7f53640a72f0 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53540038c0 con 0x7f53640a72f0 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f5354003e30 con 0x7f53640a72f0 2024-09-11T02:05:01.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f53617fa640 10 monclient: dump: 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.544 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.520+0000 7f5362ffd640 4 set_mon_vals no callback set 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.521+0000 7f536ad91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.521+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5364142960 con 0x7f536413e740 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.521+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f5354003fd0 con 0x7f53640a72f0 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.521+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7f535404e3c0 con 0x7f53640a72f0 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555168820 0 0) 0x7f5364142960 con 0x7f536413e740 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 10 monclient(hunting): my global_id is 6385 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f536413a800 con 0x7f536413e740 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f536932e640 10 monclient: get_auth_request con 0x7f5344040380 auth_method 0 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 794232246 0 0) 0x7f536413a800 con 0x7f536413e740 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5364142960 con 0x7f536413e740 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f534c003950 con 0x7f536413e740 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:01.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 10 monclient: dump: 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.547 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.548 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.548 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2168602098 0 0) 0x7f5364142960 con 0x7f536413e740 2024-09-11T02:05:01.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53640008d0 con 0x7f536413e740 2024-09-11T02:05:01.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f534c004640 con 0x7f536413e740 2024-09-11T02:05:01.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:01.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 >> v1:172.21.15.73:6791/0 conn(0x7f536413e740 legacy=0x7f5364141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.522+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 >> v1:172.21.15.73:6791/0 conn(0x7f536413e740 legacy=0x7f5364141740 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.528+0000 7f536ad91640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:05:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.528+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f536402e830 con 0x7f536402e450 2024-09-11T02:05:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3867472613 0 0) 0x7f536402e830 con 0x7f536402e450 2024-09-11T02:05:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 10 monclient(hunting): my global_id is 6394 2024-09-11T02:05:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5364142960 con 0x7f536402e450 2024-09-11T02:05:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 20296662 0 0) 0x7f5364142960 con 0x7f536402e450 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f536402e830 con 0x7f536402e450 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f534c004160 con 0x7f536402e450 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 10 monclient: dump: 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.551 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3864826391 0 0) 0x7f536402e830 con 0x7f536402e450 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 --> v1:172.21.15.73:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5364142560 con 0x7f536402e450 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 <== mon.4 v1:172.21.15.73:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 2585346362) 0x7f534c0041c0 con 0x7f536402e450 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 >> v1:172.21.15.73:6791/0 conn(0x7f536402e450 legacy=0x7f5364141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f53617fa640 1 -- 172.21.15.73:0/884923576 >> v1:172.21.15.73:6791/0 conn(0x7f536402e450 legacy=0x7f5364141e50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 52, 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 423992, 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:05:01.553 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:05:01.554 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:05:01.555 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.556 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:05:01.557 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:05:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:05:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.559 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.560 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.561 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:05:01.562 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.564 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.566 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:01.567 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.568 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:05:01.570 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:01.572 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:05:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:05:01.575 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 >> v1:172.21.15.203:6812/2311533528 conn(0x7f5344040380 legacy=0x7f5344042840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f536ad91640 10 monclient: shutdown 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f536ad91640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 >> v1:172.21.15.73:6793/0 conn(0x7f53640a72f0 legacy=0x7f53641399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f536932e640 1 -- 172.21.15.73:0/884923576 reap_dead start 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.529+0000 7f536932e640 1 -- 172.21.15.73:0/884923576 reap_dead start 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.530+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 shutdown_connections 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.530+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 >> 172.21.15.73:0/884923576 conn(0x7f53640a8050 msgr2=0x7f53640a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.530+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 shutdown_connections 2024-09-11T02:05:01.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.530+0000 7f536ad91640 1 -- 172.21.15.73:0/884923576 wait complete. 2024-09-11T02:05:01.578 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:05:01.578 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-11T02:05:01.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-11T02:05:01.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.677+0000 7f31b972c640 10 monclient: get_monmap_and_config 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.677+0000 7f31b972c640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.677+0000 7f31b972c640 10 monclient: monmap: 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:01.678261+0000 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:01.678261+0000 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.680 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.680 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 1 Processor -- start 2024-09-11T02:05:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 1 -- start start 2024-09-11T02:05:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 10 monclient: init 2024-09-11T02:05:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 10 monclient: _add_conns ranks=[4,0,5,1,3,6,7,2,8] 2024-09-11T02:05:01.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 10 monclient(hunting): picked mon.noname-c con 0x7f31b4138d40 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 10 monclient(hunting): picked mon.noname-a con 0x7f31b40a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 10 monclient(hunting): picked mon.noname-h con 0x7f31b413f350 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b409ca00 con 0x7f31b40a72f0 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b40a7070 con 0x7f31b4138d40 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b409cee0 con 0x7f31b413f350 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b972c640 10 monclient(hunting): authenticate will time out at 1143.282822s 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31abfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f31b40a72f0 0x7f31b413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60316/0 (socket says 172.21.15.73:60316) 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31abfff640 1 -- 172.21.15.73:0/3873874003 learned_addr learned my addr 172.21.15.73:0/3873874003 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.678+0000 7f31b2ffd640 1 --1- 172.21.15.73:0/3873874003 >> v1:172.21.15.73:6791/0 conn(0x7f31b4138d40 0x7f31b4139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40324/0 (socket says 172.21.15.73:40324) 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990500454 0 0) 0x7f31b40a7070 con 0x7f31b4138d40 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient(hunting): my global_id is 6403 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31a0003520 con 0x7f31b4138d40 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679095135 0 0) 0x7f31b409ca00 con 0x7f31b40a72f0 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient(hunting): my global_id is 6687 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b40a7070 con 0x7f31b40a72f0 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1044123469 0 0) 0x7f31a0003520 con 0x7f31b4138d40 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 >> v1:172.21.15.203:6791/0 conn(0x7f31b413f350 legacy=0x7f31b4141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 >> v1:172.21.15.73:6789/0 conn(0x7f31b40a72f0 legacy=0x7f31b413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 monclient: found mon.noname-c 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b409d1c0 con 0x7f31b4138d40 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b972c640 5 monclient: authenticate success, global_id 6403 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f31a4001830 con 0x7f31b4138d40 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: dump: 2024-09-11T02:05:01.692 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.693 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.694 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.694 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b972c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:01.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31a4001a50 con 0x7f31b4138d40 2024-09-11T02:05:01.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 1 -- 172.21.15.73:0/3873874003 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f31a4004b20 con 0x7f31b4138d40 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b972c640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b972c640 4 set_mon_vals no callback set 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.679+0000 7f31b27fc640 10 monclient: dump: 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.695 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.696 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.680+0000 7f31b972c640 10 monclient: shutdown 2024-09-11T02:05:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.680+0000 7f31b972c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.680+0000 7f31b972c640 1 -- 172.21.15.73:0/3873874003 >> v1:172.21.15.73:6791/0 conn(0x7f31b4138d40 legacy=0x7f31b4139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.680+0000 7f31b972c640 1 -- 172.21.15.73:0/3873874003 shutdown_connections 2024-09-11T02:05:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.680+0000 7f31b972c640 1 -- 172.21.15.73:0/3873874003 >> 172.21.15.73:0/3873874003 conn(0x7f31b40a8050 msgr2=0x7f31b40a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.680+0000 7f31b972c640 1 -- 172.21.15.73:0/3873874003 shutdown_connections 2024-09-11T02:05:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.680+0000 7f31b972c640 1 -- 172.21.15.73:0/3873874003 wait complete. 2024-09-11T02:05:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.680+0000 7f31b972c640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.680+0000 7f31b972c640 10 monclient: monmap: 2024-09-11T02:05:01.697 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:01.698 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.699 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 1 Processor -- start 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 1 -- start start 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 10 monclient: init 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 10 monclient: _add_conns ranks=[6,7,1,0,3,4,5,2,8] 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 10 monclient(hunting): picked mon.noname-d con 0x7f31b40a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 10 monclient(hunting): picked mon.noname-i con 0x7f31b4138d40 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 10 monclient(hunting): picked mon.noname-f con 0x7f31b413f350 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b413c440 con 0x7f31b413f350 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b413c720 con 0x7f31b40a72f0 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b40a5030 con 0x7f31b4138d40 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b972c640 10 monclient(hunting): authenticate will time out at 1143.285567s 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b2ffd640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f31b40a72f0 0x7f31b4138270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50284/0 (socket says 172.21.15.73:50284) 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31b2ffd640 1 -- 172.21.15.73:0/2340956815 learned_addr learned my addr 172.21.15.73:0/2340956815 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185880826 0 0) 0x7f31b413c720 con 0x7f31b40a72f0 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31ab7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31ab7fe640 10 monclient(hunting): my global_id is 115638 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3194003520 con 0x7f31b40a72f0 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.681+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1310977977 0 0) 0x7f3194003520 con 0x7f31b40a72f0 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31b413c720 con 0x7f31b40a72f0 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f31a40017f0 con 0x7f31b40a72f0 2024-09-11T02:05:01.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.702 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886267129 0 0) 0x7f31b40a5030 con 0x7f31b4138d40 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): my global_id is 6523 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3194003520 con 0x7f31b4138d40 2024-09-11T02:05:01.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733379043 0 0) 0x7f31b413c440 con 0x7f31b413f350 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient(hunting): my global_id is 144127 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b40a5030 con 0x7f31b413f350 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1319536383 0 0) 0x7f31b413c720 con 0x7f31b40a72f0 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 >> v1:172.21.15.203:6792/0 conn(0x7f31b4138d40 legacy=0x7f31b41d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 >> v1:172.21.15.203:6789/0 conn(0x7f31b413f350 legacy=0x7f31b41d54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 monclient: found mon.d 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b413ea30 con 0x7f31b40a72f0 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31b972c640 5 monclient: authenticate success, global_id 115638 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31b972c640 10 monclient: _renew_subs 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31b972c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:01.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f31b4142a10 con 0x7f31b40a72f0 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31b972c640 10 monclient: _renew_subs 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31b972c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f31b413e550 con 0x7f31b40a72f0 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31a4004de0 con 0x7f31b40a72f0 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f31a40052d0 con 0x7f31b40a72f0 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31b1ffb640 4 set_mon_vals no callback set 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.682+0000 7f31ab7fe640 10 monclient: dump: 2024-09-11T02:05:01.706 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.707 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31b972c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f31980065c0 con 0x7f3198002860 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f31a4011a10 con 0x7f31b40a72f0 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7f31a404e270 con 0x7f31b40a72f0 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306143953 0 0) 0x7f31980065c0 con 0x7f3198002860 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 10 monclient(hunting): my global_id is 115647 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b413c720 con 0x7f3198002860 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31b37fe640 10 monclient: get_auth_request con 0x7f319403ff30 auth_method 0 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2906967776 0 0) 0x7f31b413c720 con 0x7f3198002860 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31980065c0 con 0x7f3198002860 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f319c0013e0 con 0x7f3198002860 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 10 monclient: dump: 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.709 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 430308976 0 0) 0x7f31980065c0 con 0x7f3198002860 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.683+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f319800a160 con 0x7f3198002860 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.684+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f319c001600 con 0x7f3198002860 2024-09-11T02:05:01.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.684+0000 7f31ab7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.684+0000 7f31ab7fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:01.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.684+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 >> v1:172.21.15.73:6792/0 conn(0x7f3198002860 legacy=0x7f3198004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.684+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 >> v1:172.21.15.73:6792/0 conn(0x7f3198002860 legacy=0x7f3198004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31b972c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:05:01.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3198009e70 con 0x7f3198009130 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828767223 0 0) 0x7f3198009e70 con 0x7f3198009130 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 10 monclient(hunting): my global_id is 115656 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31980065c0 con 0x7f3198009130 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3459086324 0 0) 0x7f31980065c0 con 0x7f3198009130 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3198009e70 con 0x7f3198009130 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f319c004d10 con 0x7f3198009130 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 10 monclient: dump: 2024-09-11T02:05:01.713 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.714 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 480366513 0 0) 0x7f3198009e70 con 0x7f3198009130 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.690+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 --> v1:172.21.15.73:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f319800c3f0 con 0x7f3198009130 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 <== mon.6 v1:172.21.15.73:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 628056315) 0x7f319c0061c0 con 0x7f3198009130 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31ab7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31ab7fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 >> v1:172.21.15.73:6792/0 conn(0x7f3198009130 legacy=0x7f31980095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31ab7fe640 1 -- 172.21.15.73:0/2340956815 >> v1:172.21.15.73:6792/0 conn(0x7f3198009130 legacy=0x7f31980095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:01.715 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:01.716 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:05:01.716 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 52, 2024-09-11T02:05:01.716 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 268279, 2024-09-11T02:05:01.716 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:05:01.716 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:05:01.716 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:05:01.716 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:05:01.716 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.717 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.718 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.718 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.718 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.718 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.718 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.718 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.718 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.718 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.719 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.719 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.719 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:05:01.719 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:05:01.719 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.719 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.720 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.720 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.720 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.720 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.720 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.720 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.720 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.721 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.721 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.721 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.721 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.721 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:05:01.721 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:05:01.721 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:05:01.722 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:05:01.722 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:05:01.722 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:05:01.722 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.722 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.722 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:05:01.722 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:05:01.723 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:05:01.723 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:05:01.723 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:05:01.723 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:05:01.723 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:05:01.723 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:05:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.725 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.725 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.725 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.725 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.725 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.725 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.726 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:05:01.726 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.726 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:05:01.726 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.726 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:01.726 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:01.726 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.727 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.727 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:05:01.727 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.727 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.727 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.727 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.727 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:01.728 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.729 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.730 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.731 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.732 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:05:01.733 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.734 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.736 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.737 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.739 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.740 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:05:01.741 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 >> v1:172.21.15.203:6812/2311533528 conn(0x7f319403ff30 legacy=0x7f31940423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b972c640 10 monclient: shutdown 2024-09-11T02:05:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b972c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 >> v1:172.21.15.73:6792/0 conn(0x7f31b40a72f0 legacy=0x7f31b4138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b37fe640 1 -- 172.21.15.73:0/2340956815 reap_dead start 2024-09-11T02:05:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b37fe640 1 -- 172.21.15.73:0/2340956815 reap_dead start 2024-09-11T02:05:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 shutdown_connections 2024-09-11T02:05:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 >> 172.21.15.73:0/2340956815 conn(0x7f31b40a8050 msgr2=0x7f31b40a97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 shutdown_connections 2024-09-11T02:05:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.691+0000 7f31b972c640 1 -- 172.21.15.73:0/2340956815 wait complete. 2024-09-11T02:05:01.745 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:05:01.745 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-11T02:05:01.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-11T02:05:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.845+0000 7fea99182640 10 monclient: get_monmap_and_config 2024-09-11T02:05:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.845+0000 7fea99182640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.845+0000 7fea99182640 10 monclient: monmap: 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:01.845979+0000 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:01.845979+0000 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.847 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.848 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.848 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.845+0000 7fea99182640 1 Processor -- start 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.845+0000 7fea99182640 1 -- start start 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.845+0000 7fea99182640 10 monclient: init 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 10 monclient: _add_conns ranks=[6,1,7,8,3,2,4,5,0] 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 10 monclient(hunting): picked mon.noname-d con 0x7fea94138960 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 10 monclient(hunting): picked mon.noname-f con 0x7fea94139450 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 10 monclient(hunting): picked mon.noname-i con 0x7fea9413f620 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9409d030 con 0x7fea94139450 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9409d310 con 0x7fea94138960 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9406f770 con 0x7fea9413f620 2024-09-11T02:05:01.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 10 monclient(hunting): authenticate will time out at 1143.450350s 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea92d9d640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fea94138960 0x7fea94138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50296/0 (socket says 172.21.15.73:50296) 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea92d9d640 1 -- 172.21.15.73:0/3965399320 learned_addr learned my addr 172.21.15.73:0/3965399320 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471602108 0 0) 0x7fea9409d310 con 0x7fea94138960 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): my global_id is 115665 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea80003520 con 0x7fea94138960 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469815605 0 0) 0x7fea9409d030 con 0x7fea94139450 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): my global_id is 144136 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea9409d310 con 0x7fea94139450 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608480570 0 0) 0x7fea9406f770 con 0x7fea9413f620 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient(hunting): my global_id is 6532 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea9409d030 con 0x7fea9413f620 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2023515437 0 0) 0x7fea80003520 con 0x7fea94138960 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 >> v1:172.21.15.203:6792/0 conn(0x7fea9413f620 legacy=0x7fea94141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 >> v1:172.21.15.203:6789/0 conn(0x7fea94139450 legacy=0x7fea9413df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 monclient: found mon.noname-d 2024-09-11T02:05:01.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea940a7360 con 0x7fea94138960 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fea8c001830 con 0x7fea94138960 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 5 monclient: authenticate success, global_id 115665 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea91d9b640 10 monclient: dump: 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.864 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.846+0000 7fea99182640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea8c001a50 con 0x7fea94138960 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea91d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea91d9b640 1 -- 172.21.15.73:0/3965399320 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fea8c004be0 con 0x7fea94138960 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea99182640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea99182640 4 set_mon_vals no callback set 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea91d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea91d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea91d9b640 10 monclient: dump: 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.866 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea99182640 10 monclient: shutdown 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea99182640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea99182640 1 -- 172.21.15.73:0/3965399320 >> v1:172.21.15.73:6792/0 conn(0x7fea94138960 legacy=0x7fea94138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea99182640 1 -- 172.21.15.73:0/3965399320 shutdown_connections 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea99182640 1 -- 172.21.15.73:0/3965399320 >> 172.21.15.73:0/3965399320 conn(0x7fea940a8050 msgr2=0x7fea940a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea99182640 1 -- 172.21.15.73:0/3965399320 shutdown_connections 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.847+0000 7fea99182640 1 -- 172.21.15.73:0/3965399320 wait complete. 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.848+0000 7fea99182640 10 monclient: build_initial_monmap 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.848+0000 7fea99182640 10 monclient: monmap: 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:01.868 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.848+0000 7fea99182640 1 Processor -- start 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.848+0000 7fea99182640 1 -- start start 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.848+0000 7fea99182640 10 monclient: init 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:01.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 10 monclient: _add_conns ranks=[2,0,4,7,8,6,5,1,3] 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 10 monclient(hunting): picked mon.noname-b con 0x7fea94138960 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 10 monclient(hunting): picked mon.noname-a con 0x7fea94139450 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 10 monclient(hunting): picked mon.noname-c con 0x7fea9413f620 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9413aaf0 con 0x7fea94139450 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea94138db0 con 0x7fea94138960 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea940a5110 con 0x7fea9413f620 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea99182640 10 monclient(hunting): authenticate will time out at 1143.453302s 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea92d9d640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fea94138960 0x7fea94139cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41758/0 (socket says 172.21.15.73:41758) 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea9259c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fea94139450 0x7fea9413a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60326/0 (socket says 172.21.15.73:60326) 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea92d9d640 1 -- 172.21.15.73:0/1617703299 learned_addr learned my addr 172.21.15.73:0/1617703299 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:01.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3332536347 0 0) 0x7fea9413aaf0 con 0x7fea94139450 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): my global_id is 6696 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea74003520 con 0x7fea94139450 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449819659 0 0) 0x7fea94138db0 con 0x7fea94138960 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): my global_id is 134831 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea9413aaf0 con 0x7fea94138960 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822034809 0 0) 0x7fea940a5110 con 0x7fea9413f620 2024-09-11T02:05:01.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): my global_id is 6412 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea94138db0 con 0x7fea9413f620 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4026754736 0 0) 0x7fea94138db0 con 0x7fea9413f620 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea940a5110 con 0x7fea9413f620 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fea84001cf0 con 0x7fea9413f620 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.849+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1667414937 0 0) 0x7fea9413aaf0 con 0x7fea94138960 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea94138db0 con 0x7fea94138960 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1266764329 0 0) 0x7fea74003520 con 0x7fea94139450 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea9413aaf0 con 0x7fea94139450 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fea8c004b20 con 0x7fea94138960 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fea7c001a10 con 0x7fea94139450 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2044002266 0 0) 0x7fea940a5110 con 0x7fea9413f620 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 >> v1:172.21.15.73:6790/0 conn(0x7fea94138960 legacy=0x7fea94139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 >> v1:172.21.15.73:6789/0 conn(0x7fea94139450 legacy=0x7fea9413a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 monclient: found mon.c 2024-09-11T02:05:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9413c7a0 con 0x7fea9413f620 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea99182640 5 monclient: authenticate success, global_id 6412 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea99182640 10 monclient: _renew_subs 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea99182640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea9413d460 con 0x7fea9413f620 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea99182640 10 monclient: _renew_subs 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea99182640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fea9413b280 con 0x7fea9413f620 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea84003990 con 0x7fea9413f620 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea8b7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.850+0000 7fea9159a640 4 set_mon_vals no callback set 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fea84003e80 con 0x7fea9413f620 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient: dump: 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.880 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.880 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.880 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.880 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.880 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.880 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.880 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.880 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.880 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fea840105c0 con 0x7fea9413f620 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea99182640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fea780065c0 con 0x7fea78002860 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7fea8404d260 con 0x7fea9413f620 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648350321 0 0) 0x7fea780065c0 con 0x7fea78002860 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient(hunting): my global_id is 115649 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea940a5110 con 0x7fea78002860 2024-09-11T02:05:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea9259c640 10 monclient: get_auth_request con 0x7fea74040750 auth_method 0 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2098893744 0 0) 0x7fea940a5110 con 0x7fea78002860 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea780065c0 con 0x7fea78002860 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fea8c001bd0 con 0x7fea78002860 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 10 monclient: dump: 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3994700271 0 0) 0x7fea780065c0 con 0x7fea78002860 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.851+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea7800a160 con 0x7fea78002860 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.852+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fea8c001b90 con 0x7fea78002860 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.852+0000 7fea8b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.852+0000 7fea8b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.852+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 >> v1:172.21.15.73:6793/0 conn(0x7fea78002860 legacy=0x7fea78004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.852+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 >> v1:172.21.15.73:6793/0 conn(0x7fea78002860 legacy=0x7fea78004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea99182640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fea78009e70 con 0x7fea78009130 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670563293 0 0) 0x7fea78009e70 con 0x7fea78009130 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 10 monclient(hunting): my global_id is 115658 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea780065c0 con 0x7fea78009130 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 857923535 0 0) 0x7fea780065c0 con 0x7fea78009130 2024-09-11T02:05:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea78009e70 con 0x7fea78009130 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fea8c0057d0 con 0x7fea78009130 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 10 monclient: dump: 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:01.885 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 967254997 0 0) 0x7fea78009e70 con 0x7fea78009130 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.858+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 --> v1:172.21.15.73:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fea7800c3f0 con 0x7fea78009130 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 <== mon.8 v1:172.21.15.73:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 1914583658) 0x7fea8c0086d0 con 0x7fea78009130 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea8b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:05:01.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea8b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:01.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 >> v1:172.21.15.73:6793/0 conn(0x7fea78009130 legacy=0x7fea780095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea8b7fe640 1 -- 172.21.15.73:0/1617703299 >> v1:172.21.15.73:6793/0 conn(0x7fea78009130 legacy=0x7fea780095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:01.887 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:05:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 52, 2024-09-11T02:05:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 268447, 2024-09-11T02:05:01.887 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.888 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.890 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:05:01.891 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.892 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.893 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:05:01.894 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.895 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.896 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.897 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.898 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.899 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:01.900 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.901 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:05:01.902 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.903 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.904 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:05:01.905 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 >> v1:172.21.15.203:6812/2311533528 conn(0x7fea74040750 legacy=0x7fea74042c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea99182640 10 monclient: shutdown 2024-09-11T02:05:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea99182640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 >> v1:172.21.15.73:6791/0 conn(0x7fea9413f620 legacy=0x7fea941d5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea9359e640 1 -- 172.21.15.73:0/1617703299 reap_dead start 2024-09-11T02:05:01.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea9359e640 1 -- 172.21.15.73:0/1617703299 reap_dead start 2024-09-11T02:05:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 shutdown_connections 2024-09-11T02:05:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 >> 172.21.15.73:0/1617703299 conn(0x7fea940a8050 msgr2=0x7fea940a9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 shutdown_connections 2024-09-11T02:05:01.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:01.859+0000 7fea99182640 1 -- 172.21.15.73:0/1617703299 wait complete. 2024-09-11T02:05:01.908 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:05:01.908 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-11T02:05:01.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-11T02:05:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.004+0000 7f9d9ca40640 10 monclient: get_monmap_and_config 2024-09-11T02:05:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.004+0000 7f9d9ca40640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.004+0000 7f9d9ca40640 10 monclient: monmap: 2024-09-11T02:05:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:02.005778+0000 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:02.005778+0000 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.007 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.005+0000 7f9d9ca40640 1 Processor -- start 2024-09-11T02:05:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.005+0000 7f9d9ca40640 1 -- start start 2024-09-11T02:05:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.005+0000 7f9d9ca40640 10 monclient: init 2024-09-11T02:05:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 10 monclient: _add_conns ranks=[2,8,6,5,1,0,3,7,4] 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 10 monclient(hunting): picked mon.noname-b con 0x7f9d98138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 10 monclient(hunting): picked mon.noname-e con 0x7f9d980a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 10 monclient(hunting): picked mon.noname-d con 0x7f9d9813f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9809ca00 con 0x7f9d98138d40 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d980a7070 con 0x7f9d9813f350 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9809cee0 con 0x7f9d980a72f0 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 10 monclient(hunting): authenticate will time out at 1143.610306s 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9659c640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f9d98138d40 0x7f9d98139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41766/0 (socket says 172.21.15.73:41766) 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9659c640 1 -- 172.21.15.73:0/2169068580 learned_addr learned my addr 172.21.15.73:0/2169068580 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d95d9b640 1 --1- 172.21.15.73:0/2169068580 >> v1:172.21.15.73:6793/0 conn(0x7f9d980a72f0 0x7f9d9813dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35108/0 (socket says 172.21.15.73:35108) 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107439965 0 0) 0x7f9d980a7070 con 0x7f9d9813f350 2024-09-11T02:05:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): my global_id is 115674 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d80003520 con 0x7f9d9813f350 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783225374 0 0) 0x7f9d9809cee0 con 0x7f9d980a72f0 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): my global_id is 115667 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d980a7070 con 0x7f9d980a72f0 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244118632 0 0) 0x7f9d9809ca00 con 0x7f9d98138d40 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient(hunting): my global_id is 134840 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d9809cee0 con 0x7f9d98138d40 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2235416205 0 0) 0x7f9d80003520 con 0x7f9d9813f350 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 >> v1:172.21.15.73:6793/0 conn(0x7f9d980a72f0 legacy=0x7f9d9813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 >> v1:172.21.15.73:6790/0 conn(0x7f9d98138d40 legacy=0x7f9d98139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 monclient: found mon.noname-d 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9809d1c0 con 0x7f9d9813f350 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d90001760 con 0x7f9d9813f350 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9559a640 10 monclient: dump: 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.022 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 5 monclient: authenticate success, global_id 115674 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.006+0000 7f9d9ca40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d90001980 con 0x7f9d9813f350 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9559a640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9ca40640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9559a640 1 -- 172.21.15.73:0/2169068580 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d90003950 con 0x7f9d9813f350 2024-09-11T02:05:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9ca40640 4 set_mon_vals no callback set 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9559a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9559a640 10 monclient: dump: 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9ca40640 10 monclient: shutdown 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9ca40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9ca40640 1 -- 172.21.15.73:0/2169068580 >> v1:172.21.15.73:6792/0 conn(0x7f9d9813f350 legacy=0x7f9d98141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9ca40640 1 -- 172.21.15.73:0/2169068580 shutdown_connections 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9ca40640 1 -- 172.21.15.73:0/2169068580 >> 172.21.15.73:0/2169068580 conn(0x7f9d980a8050 msgr2=0x7f9d980a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9ca40640 1 -- 172.21.15.73:0/2169068580 shutdown_connections 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.007+0000 7f9d9ca40640 1 -- 172.21.15.73:0/2169068580 wait complete. 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.008+0000 7f9d9ca40640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.008+0000 7f9d9ca40640 10 monclient: monmap: 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.026 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.008+0000 7f9d9ca40640 1 Processor -- start 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.008+0000 7f9d9ca40640 1 -- start start 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.008+0000 7f9d9ca40640 10 monclient: init 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient: _add_conns ranks=[8,6,2,1,7,5,0,3,4] 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient(hunting): picked mon.noname-e con 0x7f9d980a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient(hunting): picked mon.noname-d con 0x7f9d98138d40 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient(hunting): picked mon.noname-b con 0x7f9d9813f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9813ca10 con 0x7f9d9813f350 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d981ce130 con 0x7f9d98138d40 2024-09-11T02:05:02.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d981428f0 con 0x7f9d980a72f0 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient(hunting): authenticate will time out at 1143.613170s 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d95d9b640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f9d98138d40 0x7f9d981cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50320/0 (socket says 172.21.15.73:50320) 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9659c640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f9d980a72f0 0x7f9d981cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35112/0 (socket says 172.21.15.73:35112) 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d95d9b640 1 -- 172.21.15.73:0/3576409480 learned_addr learned my addr 172.21.15.73:0/3576409480 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d96d9d640 1 --1- 172.21.15.73:0/3576409480 >> v1:172.21.15.73:6790/0 conn(0x7f9d9813f350 0x7f9d981d58a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41778/0 (socket says 172.21.15.73:41778) 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498951446 0 0) 0x7f9d981428f0 con 0x7f9d980a72f0 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): my global_id is 115676 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d78003550 con 0x7f9d980a72f0 2024-09-11T02:05:02.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 821640842 0 0) 0x7f9d981ce130 con 0x7f9d98138d40 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): my global_id is 115683 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d981428f0 con 0x7f9d98138d40 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450236815 0 0) 0x7f9d9813ca10 con 0x7f9d9813f350 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): my global_id is 134849 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d981ce130 con 0x7f9d9813f350 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4241227831 0 0) 0x7f9d981428f0 con 0x7f9d98138d40 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d9813ca10 con 0x7f9d98138d40 2024-09-11T02:05:02.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4150247935 0 0) 0x7f9d78003550 con 0x7f9d980a72f0 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d981428f0 con 0x7f9d980a72f0 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d88001610 con 0x7f9d98138d40 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.030 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2721106301 0 0) 0x7f9d981ce130 con 0x7f9d9813f350 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d78003550 con 0x7f9d9813f350 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d8c0017a0 con 0x7f9d980a72f0 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.032 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d90001720 con 0x7f9d9813f350 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.033 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3130406430 0 0) 0x7f9d9813ca10 con 0x7f9d98138d40 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 >> v1:172.21.15.73:6793/0 conn(0x7f9d980a72f0 legacy=0x7f9d981cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 >> v1:172.21.15.73:6790/0 conn(0x7f9d9813f350 legacy=0x7f9d981d58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 monclient: found mon.d 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d980a54d0 con 0x7f9d98138d40 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 5 monclient: authenticate success, global_id 115683 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient: _renew_subs 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d980a4fa0 con 0x7f9d98138d40 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient: _renew_subs 2024-09-11T02:05:02.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.009+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d980a1740 con 0x7f9d98138d40 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.010+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d88004a90 con 0x7f9d98138d40 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.010+0000 7f9d86ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.010+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d88004f80 con 0x7f9d98138d40 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.010+0000 7f9d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.010+0000 7f9d86ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.010+0000 7f9d86ffd640 10 monclient: dump: 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.010+0000 7f9d94d99640 4 set_mon_vals no callback set 2024-09-11T02:05:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.010+0000 7f9d9ca40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.010+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f9d880116c0 con 0x7f9d98138d40 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.011+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7f9d8804e300 con 0x7f9d98138d40 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.011+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d980008d0 con 0x7f9d9813b4f0 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.011+0000 7f9d9659c640 10 monclient: get_auth_request con 0x7f9d780406c0 auth_method 0 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.011+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349104727 0 0) 0x7f9d980008d0 con 0x7f9d9813b4f0 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.011+0000 7f9d86ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.011+0000 7f9d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.011+0000 7f9d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.011+0000 7f9d86ffd640 10 monclient(hunting): my global_id is 144145 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.011+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d9813ca10 con 0x7f9d9813b4f0 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 213080470 0 0) 0x7f9d9813ca10 con 0x7f9d9813b4f0 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d980008d0 con 0x7f9d9813b4f0 2024-09-11T02:05:02.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d90003930 con 0x7f9d9813b4f0 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 10 monclient: dump: 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1958801827 0 0) 0x7f9d980008d0 con 0x7f9d9813b4f0 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.203:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d9802e450 con 0x7f9d9813b4f0 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9d90005780 con 0x7f9d9813b4f0 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:02.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 >> v1:172.21.15.203:6789/0 conn(0x7f9d9813b4f0 legacy=0x7f9d98140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.012+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 >> v1:172.21.15.203:6789/0 conn(0x7f9d9813b4f0 legacy=0x7f9d98140740 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.018+0000 7f9d9ca40640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:05:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.018+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d98141560 con 0x7f9d9802e600 2024-09-11T02:05:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245792255 0 0) 0x7f9d98141560 con 0x7f9d9802e600 2024-09-11T02:05:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 10 monclient(hunting): my global_id is 144154 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d980008d0 con 0x7f9d9802e600 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2807193315 0 0) 0x7f9d980008d0 con 0x7f9d9802e600 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d98141560 con 0x7f9d9802e600 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f9d90004140 con 0x7f9d9802e600 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 10 monclient: dump: 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.044 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3316501841 0 0) 0x7f9d98141560 con 0x7f9d9802e600 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.019+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 --> v1:172.21.15.203:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d981de710 con 0x7f9d9802e600 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 <== mon.1 v1:172.21.15.203:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 3119976336) 0x7f9d900043a0 con 0x7f9d9802e600 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d86ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d86ffd640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 >> v1:172.21.15.203:6789/0 conn(0x7f9d9802e600 legacy=0x7f9d98140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d86ffd640 1 -- 172.21.15.73:0/3576409480 >> v1:172.21.15.203:6789/0 conn(0x7f9d9802e600 legacy=0x7f9d98140e50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:02.045 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 52, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 16210, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:05:02.046 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.047 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.048 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:05:02.049 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.050 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.051 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:02.054 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.055 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:05:02.057 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.058 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:05:02.060 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.062 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:05:02.063 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.064 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.065 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:05:02.065 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 >> v1:172.21.15.203:6812/2311533528 conn(0x7f9d780406c0 legacy=0x7f9d78042b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d9ca40640 10 monclient: shutdown 2024-09-11T02:05:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d9ca40640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 >> v1:172.21.15.73:6792/0 conn(0x7f9d98138d40 legacy=0x7f9d981cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d96d9d640 1 -- 172.21.15.73:0/3576409480 reap_dead start 2024-09-11T02:05:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 shutdown_connections 2024-09-11T02:05:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 >> 172.21.15.73:0/3576409480 conn(0x7f9d980a8050 msgr2=0x7f9d980a96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 shutdown_connections 2024-09-11T02:05:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.020+0000 7f9d9ca40640 1 -- 172.21.15.73:0/3576409480 wait complete. 2024-09-11T02:05:02.067 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:05:02.067 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-11T02:05:02.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-11T02:05:02.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.163+0000 7fa211e79640 10 monclient: get_monmap_and_config 2024-09-11T02:05:02.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.163+0000 7fa211e79640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.163+0000 7fa211e79640 10 monclient: monmap: 2024-09-11T02:05:02.165 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.165 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.165 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:02.164729+0000 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:02.164729+0000 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.166 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.167 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.164+0000 7fa211e79640 1 Processor -- start 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.164+0000 7fa211e79640 1 -- start start 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.164+0000 7fa211e79640 10 monclient: init 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 10 monclient: _add_conns ranks=[8,5,0,6,2,3,4,7,1] 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 10 monclient(hunting): picked mon.noname-e con 0x7fa20c09e3a0 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 10 monclient(hunting): picked mon.noname-h con 0x7fa20c09ee90 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 10 monclient(hunting): picked mon.noname-a con 0x7fa20c13c250 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c0a13a0 con 0x7fa20c13c250 2024-09-11T02:05:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c09fbb0 con 0x7fa20c09ee90 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c09fe90 con 0x7fa20c09e3a0 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 10 monclient(hunting): authenticate will time out at 1143.769215s 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa20c13c250 0x7fa20c13e640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60340/0 (socket says 172.21.15.73:60340) 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20bfff640 1 -- 172.21.15.73:0/1932788664 learned_addr learned my addr 172.21.15.73:0/1932788664 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20b7fe640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fa20c09e3a0 0x7fa20c09e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35128/0 (socket says 172.21.15.73:35128) 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297547245 0 0) 0x7fa20c09fe90 con 0x7fa20c09e3a0 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient(hunting): my global_id is 115685 2024-09-11T02:05:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f4003520 con 0x7fa20c09e3a0 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2615239256 0 0) 0x7fa20c0a13a0 con 0x7fa20c13c250 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient(hunting): my global_id is 6705 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa20c09fe90 con 0x7fa20c13c250 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3291456509 0 0) 0x7fa1f4003520 con 0x7fa20c09e3a0 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 >> v1:172.21.15.203:6791/0 conn(0x7fa20c09ee90 legacy=0x7fa20c13ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 >> v1:172.21.15.73:6789/0 conn(0x7fa20c13c250 legacy=0x7fa20c13e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 monclient: found mon.noname-e 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c0a0170 con 0x7fa20c09e3a0 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa1fc001bb0 con 0x7fa20c09e3a0 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: dump: 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 5 monclient: authenticate success, global_id 115685 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1fc001dd0 con 0x7fa20c09e3a0 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa211e79640 4 set_mon_vals no callback set 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 1 -- 172.21.15.73:0/1932788664 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa1fc004ea0 con 0x7fa20c09e3a0 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.165+0000 7fa20a7fc640 10 monclient: dump: 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.166+0000 7fa211e79640 10 monclient: shutdown 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.166+0000 7fa211e79640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.166+0000 7fa211e79640 1 -- 172.21.15.73:0/1932788664 >> v1:172.21.15.73:6793/0 conn(0x7fa20c09e3a0 legacy=0x7fa20c09e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.166+0000 7fa211e79640 1 -- 172.21.15.73:0/1932788664 shutdown_connections 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.166+0000 7fa211e79640 1 -- 172.21.15.73:0/1932788664 >> 172.21.15.73:0/1932788664 conn(0x7fa20c0a7800 msgr2=0x7fa20c0a39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.166+0000 7fa211e79640 1 -- 172.21.15.73:0/1932788664 shutdown_connections 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.166+0000 7fa211e79640 1 -- 172.21.15.73:0/1932788664 wait complete. 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.166+0000 7fa211e79640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.166+0000 7fa211e79640 10 monclient: monmap: 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.182 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 1 Processor -- start 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 1 -- start start 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 10 monclient: init 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 10 monclient: _add_conns ranks=[5,3,0,6,7,2,8,4,1] 2024-09-11T02:05:02.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 10 monclient(hunting): picked mon.noname-h con 0x7fa20c09e3a0 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 10 monclient(hunting): picked mon.noname-g con 0x7fa20c09ee90 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 10 monclient(hunting): picked mon.noname-a con 0x7fa20c13c250 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c124cf0 con 0x7fa20c13c250 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c1220c0 con 0x7fa20c09ee90 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c124fd0 con 0x7fa20c09e3a0 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.167+0000 7fa211e79640 10 monclient(hunting): authenticate will time out at 1143.771984s 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa20bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa20c13c250 0x7fa20c1d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60354/0 (socket says 172.21.15.73:60354) 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa20bfff640 1 -- 172.21.15.73:0/4047940695 learned_addr learned my addr 172.21.15.73:0/4047940695 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567258224 0 0) 0x7fa20c124cf0 con 0x7fa20c13c250 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): my global_id is 6714 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f8003550 con 0x7fa20c13c250 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3277366745 0 0) 0x7fa1f8003550 con 0x7fa20c13c250 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa20c124cf0 con 0x7fa20c13c250 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa2040018a0 con 0x7fa20c13c250 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): dump: 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.186 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.186 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.186 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.186 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080085154 0 0) 0x7fa20c124fd0 con 0x7fa20c09e3a0 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient(hunting): my global_id is 144158 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f8003550 con 0x7fa20c09e3a0 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 787288928 0 0) 0x7fa20c124cf0 con 0x7fa20c13c250 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 >> v1:172.21.15.203:6791/0 conn(0x7fa20c09e3a0 legacy=0x7fa20c1212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 >> v1:172.21.15.203:6790/0 conn(0x7fa20c09ee90 legacy=0x7fa20c1219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 monclient: found mon.a 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c073590 con 0x7fa20c13c250 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa211e79640 5 monclient: authenticate success, global_id 6714 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa211e79640 10 monclient: _renew_subs 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa211e79640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa20c124160 con 0x7fa20c13c250 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa211e79640 10 monclient: _renew_subs 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa211e79640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa20c123aa0 con 0x7fa20c13c250 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa204001c40 con 0x7fa20c13c250 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa1f3fff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.168+0000 7fa209ffb640 4 set_mon_vals no callback set 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa204004dd0 con 0x7fa20c13c250 2024-09-11T02:05:02.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 10 monclient: dump: 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.191 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa211e79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa1ec0065c0 con 0x7fa1ec002860 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fa204005030 con 0x7fa20c13c250 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7fa20404e1b0 con 0x7fa20c13c250 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 135923661 0 0) 0x7fa1ec0065c0 con 0x7fa1ec002860 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 10 monclient(hunting): my global_id is 6546 2024-09-11T02:05:02.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.169+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa20c124cf0 con 0x7fa1ec002860 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa20affd640 10 monclient: get_auth_request con 0x7fa1f803fc50 auth_method 0 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2373360167 0 0) 0x7fa20c124cf0 con 0x7fa1ec002860 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1ec0065c0 con 0x7fa1ec002860 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa1fc001b70 con 0x7fa1ec002860 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 10 monclient: dump: 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.193 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1701373926 0 0) 0x7fa1ec0065c0 con 0x7fa1ec002860 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.203:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1ec00a160 con 0x7fa1ec002860 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa1fc004d50 con 0x7fa1ec002860 2024-09-11T02:05:02.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:02.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 >> v1:172.21.15.203:6790/0 conn(0x7fa1ec002860 legacy=0x7fa1ec004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.170+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 >> v1:172.21.15.203:6790/0 conn(0x7fa1ec002860 legacy=0x7fa1ec004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:02.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.176+0000 7fa211e79640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:05:02.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.176+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa1ec009e70 con 0x7fa1ec009130 2024-09-11T02:05:02.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639269438 0 0) 0x7fa1ec009e70 con 0x7fa1ec009130 2024-09-11T02:05:02.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 10 monclient(hunting): my global_id is 6555 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1ec0065c0 con 0x7fa1ec009130 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3665797381 0 0) 0x7fa1ec0065c0 con 0x7fa1ec009130 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1ec009e70 con 0x7fa1ec009130 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa1fc0054a0 con 0x7fa1ec009130 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 10 monclient: dump: 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.197 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1669628351 0 0) 0x7fa1ec009e70 con 0x7fa1ec009130 2024-09-11T02:05:02.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.177+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 --> v1:172.21.15.203:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa1ec00c410 con 0x7fa1ec009130 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 <== mon.3 v1:172.21.15.203:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7878 (unknown 0 0 358189430) 0x7fa1fc007ed0 con 0x7fa1ec009130 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa1f3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa1f3fff640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 >> v1:172.21.15.203:6790/0 conn(0x7fa1ec009130 legacy=0x7fa1ec0095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa1f3fff640 1 -- 172.21.15.73:0/4047940695 >> v1:172.21.15.203:6790/0 conn(0x7fa1ec009130 legacy=0x7fa1ec0095c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:05:02.199 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 52, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 424615, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:05:02.200 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.201 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.202 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:02.203 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.204 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:02.205 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.206 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.208 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:02.209 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.210 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.211 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.212 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.213 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:05:02.214 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.215 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-09-11T02:05:02.218 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:02.219 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.220 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:05:02.220 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 >> v1:172.21.15.203:6812/2311533528 conn(0x7fa1f803fc50 legacy=0x7fa1f8042110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa211e79640 10 monclient: shutdown 2024-09-11T02:05:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa211e79640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 >> v1:172.21.15.73:6789/0 conn(0x7fa20c13c250 legacy=0x7fa20c1d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa20bfff640 1 -- 172.21.15.73:0/4047940695 reap_dead start 2024-09-11T02:05:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa20bfff640 1 -- 172.21.15.73:0/4047940695 reap_dead start 2024-09-11T02:05:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 shutdown_connections 2024-09-11T02:05:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 >> 172.21.15.73:0/4047940695 conn(0x7fa20c0a7800 msgr2=0x7fa20c0737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 shutdown_connections 2024-09-11T02:05:02.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.178+0000 7fa211e79640 1 -- 172.21.15.73:0/4047940695 wait complete. 2024-09-11T02:05:02.222 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:05:02.222 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-11T02:05:02.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.319+0000 7f8846b16640 10 monclient: get_monmap_and_config 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.319+0000 7f8846b16640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.319+0000 7f8846b16640 10 monclient: monmap: 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:02.320210+0000 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:02.320210+0000 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.321 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.322 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.322 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 1 Processor -- start 2024-09-11T02:05:02.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 1 -- start start 2024-09-11T02:05:02.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 10 monclient: init 2024-09-11T02:05:02.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 10 monclient: _add_conns ranks=[2,1,8,0,5,4,7,3,6] 2024-09-11T02:05:02.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 10 monclient(hunting): picked mon.noname-b con 0x7f8840138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:02.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 10 monclient(hunting): picked mon.noname-f con 0x7f88400a72f0 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:02.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 10 monclient(hunting): picked mon.noname-e con 0x7f884013f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:02.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884009ca00 con 0x7f88400a72f0 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88400a7070 con 0x7f8840138d40 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884009cee0 con 0x7f884013f350 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f8846b16640 10 monclient(hunting): authenticate will time out at 1143.924649s 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f88448b2640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f8840138d40 0x7f8840139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41792/0 (socket says 172.21.15.73:41792) 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f88448b2640 1 -- 172.21.15.73:0/4077298694 learned_addr learned my addr 172.21.15.73:0/4077298694 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f88450b3640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f884013f350 0x7f8840141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35138/0 (socket says 172.21.15.73:35138) 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 477620430 0 0) 0x7f88400a7070 con 0x7f8840138d40 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f883f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f883f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f883f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f883f7fe640 10 monclient(hunting): my global_id is 134858 2024-09-11T02:05:02.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8830003520 con 0x7f8840138d40 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.320+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571754233 0 0) 0x7f884009cee0 con 0x7f884013f350 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient(hunting): my global_id is 115694 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88400a7070 con 0x7f884013f350 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3024783257 0 0) 0x7f8830003520 con 0x7f8840138d40 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 >> v1:172.21.15.73:6793/0 conn(0x7f884013f350 legacy=0x7f8840141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 >> v1:172.21.15.203:6789/0 conn(0x7f88400a72f0 legacy=0x7f884013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 1 monclient: found mon.noname-b 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884009d1c0 con 0x7f8840138d40 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 5 monclient: authenticate success, global_id 134858 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8834001830 con 0x7f8840138d40 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: dump: 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.334 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:02.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8834001a50 con 0x7f8840138d40 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 1 -- 172.21.15.73:0/4077298694 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8834004be0 con 0x7f8840138d40 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 4 set_mon_vals no callback set 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f883f7fe640 10 monclient: dump: 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.336 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 10 monclient: shutdown 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 1 -- 172.21.15.73:0/4077298694 >> v1:172.21.15.73:6790/0 conn(0x7f8840138d40 legacy=0x7f8840139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 1 -- 172.21.15.73:0/4077298694 shutdown_connections 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 1 -- 172.21.15.73:0/4077298694 >> 172.21.15.73:0/4077298694 conn(0x7f88400a8050 msgr2=0x7f88400a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 1 -- 172.21.15.73:0/4077298694 shutdown_connections 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.321+0000 7f8846b16640 1 -- 172.21.15.73:0/4077298694 wait complete. 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.322+0000 7f8846b16640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.322+0000 7f8846b16640 10 monclient: monmap: 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.338 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.322+0000 7f8846b16640 1 Processor -- start 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.322+0000 7f8846b16640 1 -- start start 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.322+0000 7f8846b16640 10 monclient: init 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 10 monclient: _add_conns ranks=[6,2,7,3,1,4,0,8,5] 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 10 monclient(hunting): picked mon.noname-d con 0x7f88400a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 10 monclient(hunting): picked mon.noname-b con 0x7f8840138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 10 monclient(hunting): picked mon.noname-i con 0x7f884013f350 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:02.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88400a51e0 con 0x7f8840138d40 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884013b150 con 0x7f88400a72f0 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884013b430 con 0x7f884013f350 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f8846b16640 10 monclient(hunting): authenticate will time out at 1143.927419s 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883ffff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f8840138d40 0x7f88401d1d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41796/0 (socket says 172.21.15.73:41796) 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883ffff640 1 -- 172.21.15.73:0/2214438671 learned_addr learned my addr 172.21.15.73:0/2214438671 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f88448b2640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f88400a72f0 0x7f88401381f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50330/0 (socket says 172.21.15.73:50330) 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931811509 0 0) 0x7f884009ca00 con 0x7f8840138d40 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): my global_id is 134867 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8824003520 con 0x7f8840138d40 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386219390 0 0) 0x7f884013b150 con 0x7f88400a72f0 2024-09-11T02:05:02.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): my global_id is 115692 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f884009ca00 con 0x7f88400a72f0 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4280369017 0 0) 0x7f884009ca00 con 0x7f88400a72f0 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f884013b150 con 0x7f88400a72f0 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f8834004b20 con 0x7f88400a72f0 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): dump: 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.341 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.323+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1328827202 0 0) 0x7f8824003520 con 0x7f8840138d40 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f884009ca00 con 0x7f8840138d40 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f882c001b40 con 0x7f8840138d40 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient(hunting): dump: 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.343 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052463645 0 0) 0x7f884013b430 con 0x7f884013f350 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient(hunting): my global_id is 6541 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8824003520 con 0x7f884013f350 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1162542305 0 0) 0x7f884013b150 con 0x7f88400a72f0 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 >> v1:172.21.15.203:6792/0 conn(0x7f884013f350 legacy=0x7f88401d54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 >> v1:172.21.15.73:6790/0 conn(0x7f8840138d40 legacy=0x7f88401d1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 monclient: found mon.d 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884013ea30 con 0x7f88400a72f0 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f8846b16640 5 monclient: authenticate success, global_id 115692 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f8846b16640 10 monclient: _renew_subs 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f8846b16640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88401427f0 con 0x7f88400a72f0 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f8846b16640 10 monclient: _renew_subs 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f8846b16640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f88401d6bc0 con 0x7f88400a72f0 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8834004ea0 con 0x7f88400a72f0 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f88340019b0 con 0x7f88400a72f0 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883effd640 4 set_mon_vals no callback set 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:02.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f883d7fa640 10 monclient: dump: 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.347 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f8846b16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.324+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f88200065c0 con 0x7f8820002860 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f8834011930 con 0x7f88400a72f0 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7f883404e250 con 0x7f88400a72f0 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f88450b3640 10 monclient: get_auth_request con 0x7f88240403c0 auth_method 0 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497832631 0 0) 0x7f88200065c0 con 0x7f8820002860 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 10 monclient(hunting): my global_id is 144167 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f884013b150 con 0x7f8820002860 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 746012222 0 0) 0x7f884013b150 con 0x7f8820002860 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88200065c0 con 0x7f8820002860 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f882c003c20 con 0x7f8820002860 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.325+0000 7f883d7fa640 10 monclient: dump: 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.349 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.326+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2386835200 0 0) 0x7f88200065c0 con 0x7f8820002860 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.326+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.203:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f882000a160 con 0x7f8820002860 2024-09-11T02:05:02.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.326+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f882c0057c0 con 0x7f8820002860 2024-09-11T02:05:02.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.326+0000 7f883d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.326+0000 7f883d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:02.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.326+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 >> v1:172.21.15.203:6791/0 conn(0x7f8820002860 legacy=0x7f8820004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.326+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 >> v1:172.21.15.203:6791/0 conn(0x7f8820002860 legacy=0x7f8820004d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:02.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.332+0000 7f8846b16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:05:02.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.332+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8820009e00 con 0x7f88200090e0 2024-09-11T02:05:02.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464599888 0 0) 0x7f8820009e00 con 0x7f88200090e0 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 10 monclient(hunting): my global_id is 144176 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88200065c0 con 0x7f88200090e0 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3563767923 0 0) 0x7f88200065c0 con 0x7f88200090e0 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8820009e00 con 0x7f88200090e0 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f882c004360 con 0x7f88200090e0 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 10 monclient: dump: 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.353 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.354 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3183256458 0 0) 0x7f8820009e00 con 0x7f88200090e0 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.333+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 --> v1:172.21.15.203:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f882000c3a0 con 0x7f88200090e0 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 <== mon.5 v1:172.21.15.203:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2086690139) 0x7f882c005970 con 0x7f88200090e0 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f883d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f883d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 >> v1:172.21.15.203:6791/0 conn(0x7f88200090e0 legacy=0x7f8820009550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f883d7fa640 1 -- 172.21.15.73:0/2214438671 >> v1:172.21.15.203:6791/0 conn(0x7f88200090e0 legacy=0x7f8820009550 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:02.355 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 52, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 16523, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:05:02.356 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.357 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.358 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:05:02.359 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.360 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.361 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:05:02.362 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:05:02.363 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.364 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.366 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.367 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:02.368 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.369 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.370 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:02.372 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.373 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:05:02.374 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.375 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.375 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.375 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:02.375 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.375 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.375 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.375 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:05:02.375 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:02.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 >> v1:172.21.15.203:6812/2311533528 conn(0x7f88240403c0 legacy=0x7f8824042880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f8846b16640 10 monclient: shutdown 2024-09-11T02:05:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f8846b16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 >> v1:172.21.15.73:6792/0 conn(0x7f88400a72f0 legacy=0x7f88401381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f88450b3640 1 -- 172.21.15.73:0/2214438671 reap_dead start 2024-09-11T02:05:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f88450b3640 1 -- 172.21.15.73:0/2214438671 reap_dead start 2024-09-11T02:05:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 shutdown_connections 2024-09-11T02:05:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 >> 172.21.15.73:0/2214438671 conn(0x7f88400a8050 msgr2=0x7f884013ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 shutdown_connections 2024-09-11T02:05:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.334+0000 7f8846b16640 1 -- 172.21.15.73:0/2214438671 wait complete. 2024-09-11T02:05:02.378 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:05:02.378 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-11T02:05:02.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-11T02:05:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.474+0000 7fa75ba23640 10 monclient: get_monmap_and_config 2024-09-11T02:05:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.474+0000 7fa75ba23640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.474+0000 7fa75ba23640 10 monclient: monmap: 2024-09-11T02:05:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.476 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:02.475431+0000 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:02.475431+0000 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.477 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.478 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 1 Processor -- start 2024-09-11T02:05:02.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 1 -- start start 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 10 monclient: init 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 10 monclient: _add_conns ranks=[3,2,8,0,7,1,5,4,6] 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 10 monclient(hunting): picked mon.noname-g con 0x7fa754138d40 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 10 monclient(hunting): picked mon.noname-b con 0x7fa7540a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 10 monclient(hunting): picked mon.noname-e con 0x7fa75413f350 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75409ca00 con 0x7fa7540a72f0 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7540a7070 con 0x7fa754138d40 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75409cee0 con 0x7fa75413f350 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.475+0000 7fa75ba23640 10 monclient(hunting): authenticate will time out at 1144.079931s 2024-09-11T02:05:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa758fbe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fa7540a72f0 0x7fa75413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41802/0 (socket says 172.21.15.73:41802) 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa758fbe640 1 -- 172.21.15.73:0/3199404916 learned_addr learned my addr 172.21.15.73:0/3199404916 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064394305 0 0) 0x7fa75409ca00 con 0x7fa7540a72f0 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient(hunting): my global_id is 134876 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa740003520 con 0x7fa7540a72f0 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717720637 0 0) 0x7fa75409cee0 con 0x7fa75413f350 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient(hunting): my global_id is 115703 2024-09-11T02:05:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa75409ca00 con 0x7fa75413f350 2024-09-11T02:05:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2316873768 0 0) 0x7fa740003520 con 0x7fa7540a72f0 2024-09-11T02:05:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 >> v1:172.21.15.73:6793/0 conn(0x7fa75413f350 legacy=0x7fa754141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 >> v1:172.21.15.203:6790/0 conn(0x7fa754138d40 legacy=0x7fa754139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 monclient: found mon.noname-b 2024-09-11T02:05:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75409d1c0 con 0x7fa7540a72f0 2024-09-11T02:05:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa75ba23640 5 monclient: authenticate success, global_id 134876 2024-09-11T02:05:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa75ba23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa744001780 con 0x7fa7540a72f0 2024-09-11T02:05:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: dump: 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.491 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa75ba23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7440019a0 con 0x7fa7540a72f0 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 1 -- 172.21.15.73:0/3199404916 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa744004be0 con 0x7fa7540a72f0 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa74bfff640 10 monclient: dump: 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.492 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa75ba23640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:02.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.476+0000 7fa75ba23640 4 set_mon_vals no callback set 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.477+0000 7fa75ba23640 10 monclient: shutdown 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.477+0000 7fa75ba23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.477+0000 7fa75ba23640 1 -- 172.21.15.73:0/3199404916 >> v1:172.21.15.73:6790/0 conn(0x7fa7540a72f0 legacy=0x7fa75413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.477+0000 7fa75ba23640 1 -- 172.21.15.73:0/3199404916 shutdown_connections 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.477+0000 7fa75ba23640 1 -- 172.21.15.73:0/3199404916 >> 172.21.15.73:0/3199404916 conn(0x7fa7540a8050 msgr2=0x7fa7540a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.477+0000 7fa75ba23640 1 -- 172.21.15.73:0/3199404916 shutdown_connections 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.477+0000 7fa75ba23640 1 -- 172.21.15.73:0/3199404916 wait complete. 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.477+0000 7fa75ba23640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.477+0000 7fa75ba23640 10 monclient: monmap: 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:02.494 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 1 Processor -- start 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 1 -- start start 2024-09-11T02:05:02.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 10 monclient: init 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 10 monclient: _add_conns ranks=[7,8,2,4,0,3,6,5,1] 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 10 monclient(hunting): picked mon.noname-i con 0x7fa7540a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 10 monclient(hunting): picked mon.noname-e con 0x7fa754138d40 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 10 monclient(hunting): picked mon.noname-b con 0x7fa75413f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7540a5230 con 0x7fa75413f350 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7540a19f0 con 0x7fa7540a72f0 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75409fa60 con 0x7fa754138d40 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa75ba23640 10 monclient(hunting): authenticate will time out at 1144.082570s 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa758fbe640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7fa754138d40 0x7fa75409f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35144/0 (socket says 172.21.15.73:35144) 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa758fbe640 1 -- 172.21.15.73:0/1569515615 learned_addr learned my addr 172.21.15.73:0/1569515615 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042619065 0 0) 0x7fa75409fa60 con 0x7fa754138d40 2024-09-11T02:05:02.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 10 monclient(hunting): my global_id is 115712 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa738003520 con 0x7fa754138d40 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212873034 0 0) 0x7fa74c0014f0 con 0x7fa75413f350 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 10 monclient(hunting): my global_id is 134885 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.478+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa75409fa60 con 0x7fa75413f350 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 23777122 0 0) 0x7fa738003520 con 0x7fa754138d40 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa74c0014f0 con 0x7fa754138d40 2024-09-11T02:05:02.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa7440047e0 con 0x7fa754138d40 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): dump: 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.498 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 302737851 0 0) 0x7fa75409fa60 con 0x7fa75413f350 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa738003520 con 0x7fa75413f350 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa74c001ee0 con 0x7fa75413f350 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): dump: 2024-09-11T02:05:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248231633 0 0) 0x7fa7540a19f0 con 0x7fa7540a72f0 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient(hunting): my global_id is 6550 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa75409fa60 con 0x7fa7540a72f0 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1133650168 0 0) 0x7fa74c0014f0 con 0x7fa754138d40 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 >> v1:172.21.15.203:6792/0 conn(0x7fa7540a72f0 legacy=0x7fa75409ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 >> v1:172.21.15.73:6790/0 conn(0x7fa75413f350 legacy=0x7fa7541d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 monclient: found mon.e 2024-09-11T02:05:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa754142150 con 0x7fa754138d40 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa75ba23640 5 monclient: authenticate success, global_id 115712 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa75ba23640 10 monclient: _renew_subs 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa75ba23640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa7540a1150 con 0x7fa754138d40 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa744004c30 con 0x7fa754138d40 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa7440051e0 con 0x7fa754138d40 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa749ffb640 10 monclient: dump: 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa74b7fe640 4 set_mon_vals no callback set 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa75ba23640 10 monclient: _renew_subs 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa75ba23640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.479+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fa754138750 con 0x7fa754138d40 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fa744011920 con 0x7fa754138d40 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa75ba23640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa7540008d0 con 0x7fa7540a1390 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(316..316 src has 218..316) ==== 3506+0+0 (unknown 23450568 0 0) 0x7fa74404e2f0 con 0x7fa754138d40 2024-09-11T02:05:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa759fc0640 10 monclient: get_auth_request con 0x7fa738040400 auth_method 0 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368241652 0 0) 0x7fa7540008d0 con 0x7fa7540a1390 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 10 monclient(hunting): my global_id is 6559 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa74c0014f0 con 0x7fa7540a1390 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2308421162 0 0) 0x7fa74c0014f0 con 0x7fa7540a1390 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7540008d0 con 0x7fa7540a1390 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa7500019b0 con 0x7fa7540a1390 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.480+0000 7fa749ffb640 10 monclient: dump: 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.505 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.506 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.507 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.481+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3457250887 0 0) 0x7fa7540008d0 con 0x7fa7540a1390 2024-09-11T02:05:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.481+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.203:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa754141a70 con 0x7fa7540a1390 2024-09-11T02:05:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.481+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa750001c60 con 0x7fa7540a1390 2024-09-11T02:05:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.481+0000 7fa749ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.481+0000 7fa749ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.481+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 >> v1:172.21.15.203:6792/0 conn(0x7fa7540a1390 legacy=0x7fa7540a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.481+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 >> v1:172.21.15.203:6792/0 conn(0x7fa7540a1390 legacy=0x7fa7540a2d80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.487+0000 7fa75ba23640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-11T02:05:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.487+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa75413e580 con 0x7fa75413e1a0 2024-09-11T02:05:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.487+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496907563 0 0) 0x7fa75413e580 con 0x7fa75413e1a0 2024-09-11T02:05:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.487+0000 7fa749ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.487+0000 7fa749ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.487+0000 7fa749ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.487+0000 7fa749ffb640 10 monclient(hunting): my global_id is 6568 2024-09-11T02:05:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.487+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7540008d0 con 0x7fa75413e1a0 2024-09-11T02:05:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3593910342 0 0) 0x7fa7540008d0 con 0x7fa75413e1a0 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa75413e580 con 0x7fa75413e1a0 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fa750003b60 con 0x7fa75413e1a0 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 10 monclient: dump: 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.510 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2640111836 0 0) 0x7fa75413e580 con 0x7fa75413e1a0 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 --> v1:172.21.15.203:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa7540a3ba0 con 0x7fa75413e1a0 2024-09-11T02:05:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 <== mon.7 v1:172.21.15.203:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 1547455871) 0x7fa750005010 con 0x7fa75413e1a0 2024-09-11T02:05:02.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-11T02:05:02.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:02.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 >> v1:172.21.15.203:6792/0 conn(0x7fa75413e1a0 legacy=0x7fa7540a3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.488+0000 7fa749ffb640 1 -- 172.21.15.73:0/1569515615 >> v1:172.21.15.203:6792/0 conn(0x7fa75413e1a0 legacy=0x7fa7540a3490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T02:05:02.512 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:02.512 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:02.512 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:02.512 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 52, 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 424909, 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: 3, 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: 4, 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: 5, 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: 6, 2024-09-11T02:05:02.513 INFO:teuthology.orchestra.run.smithi073.stdout: 7, 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: 8 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2450521708007866372", 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.514 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540719139924082687", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.515 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "8cb5cb9a-3379-4e99-9a99-10d441f3d8e4", 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:02.516 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-09-11T01:57:30.356953Z", 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 19, 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "squid", 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 3, 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-09-11T02:05:02.517 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "reef", 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "squid" 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.518 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-09-11T02:05:02.519 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-09-11T02:05:02.519 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.519 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.519 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.519 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-09-11T02:05:02.519 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-09-11T02:05:02.520 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "f", 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789", 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6789/0", 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6789/0", 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.521 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790", 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6790/0", 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6790/0", 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 3, 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "g", 2024-09-11T02:05:02.523 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790", 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6790/0", 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6790/0", 2024-09-11T02:05:02.524 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 4, 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791", 2024-09-11T02:05:02.525 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6791/0", 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6791/0", 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 5, 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "h", 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791", 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6791/0", 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6791/0", 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 6, 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "d", 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792", 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6792/0", 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6792/0", 2024-09-11T02:05:02.528 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 7, 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "i", 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792", 2024-09-11T02:05:02.529 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.203:6792/0", 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.203:6792/0", 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.530 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 8, 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "e", 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793", 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6793/0", 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6793/0", 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-09-11T02:05:02.532 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-09-11T02:05:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-09-11T02:05:02.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f03dffffffdffff", 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "squid", 2024-09-11T02:05:02.534 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-09-11T02:05:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-11T02:05:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-11T02:05:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-11T02:05:02.535 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-09-11T02:05:02.535 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 >> v1:172.21.15.203:6812/2311533528 conn(0x7fa738040400 legacy=0x7fa7380428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa75ba23640 10 monclient: shutdown 2024-09-11T02:05:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa75ba23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 >> v1:172.21.15.73:6793/0 conn(0x7fa754138d40 legacy=0x7fa75409f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa759fc0640 1 -- 172.21.15.73:0/1569515615 reap_dead start 2024-09-11T02:05:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa759fc0640 1 -- 172.21.15.73:0/1569515615 reap_dead start 2024-09-11T02:05:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 shutdown_connections 2024-09-11T02:05:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 >> 172.21.15.73:0/1569515615 conn(0x7fa7540a8050 msgr2=0x7fa75413ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 shutdown_connections 2024-09-11T02:05:02.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.489+0000 7fa75ba23640 1 -- 172.21.15.73:0/1569515615 wait complete. 2024-09-11T02:05:02.538 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-11T02:05:02.538 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T02:05:02.539 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T02:05:02.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.640+0000 7f2e6b69b640 10 monclient: get_monmap_and_config 2024-09-11T02:05:02.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.640+0000 7f2e6b69b640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.640+0000 7f2e6b69b640 10 monclient: monmap: 2024-09-11T02:05:02.641 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.641 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:02.640881+0000 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:02.640881+0000 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.642 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.640+0000 7f2e6b69b640 1 Processor -- start 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.640+0000 7f2e6b69b640 1 -- start start 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.640+0000 7f2e6b69b640 10 monclient: init 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 10 monclient: _add_conns ranks=[1,2,4,8,0,5,7,6,3] 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 10 monclient(hunting): picked mon.noname-f con 0x7f2e64138960 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 10 monclient(hunting): picked mon.noname-b con 0x7f2e64139450 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 10 monclient(hunting): picked mon.noname-c con 0x7f2e6413f620 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6409d030 con 0x7f2e64138960 2024-09-11T02:05:02.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6409d310 con 0x7f2e64139450 2024-09-11T02:05:02.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6406f770 con 0x7f2e6413f620 2024-09-11T02:05:02.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e6b69b640 10 monclient(hunting): authenticate will time out at 1144.245505s 2024-09-11T02:05:02.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e68c36640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f2e64139450 0x7f2e6413df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41816/0 (socket says 172.21.15.73:41816) 2024-09-11T02:05:02.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.641+0000 7f2e68c36640 1 -- 172.21.15.73:0/562896166 learned_addr learned my addr 172.21.15.73:0/562896166 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264322504 0 0) 0x7f2e6409d030 con 0x7f2e64138960 2024-09-11T02:05:02.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): my global_id is 144172 2024-09-11T02:05:02.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e50003520 con 0x7f2e64138960 2024-09-11T02:05:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295260676 0 0) 0x7f2e6406f770 con 0x7f2e6413f620 2024-09-11T02:05:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): my global_id is 6421 2024-09-11T02:05:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6409d030 con 0x7f2e6413f620 2024-09-11T02:05:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894591598 0 0) 0x7f2e6409d310 con 0x7f2e64139450 2024-09-11T02:05:02.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 10 monclient(hunting): my global_id is 134894 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6406f770 con 0x7f2e64139450 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 539006546 0 0) 0x7f2e6406f770 con 0x7f2e64139450 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 >> v1:172.21.15.73:6791/0 conn(0x7f2e6413f620 legacy=0x7f2e64141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.645+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 >> v1:172.21.15.203:6789/0 conn(0x7f2e64138960 legacy=0x7f2e64138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 1 monclient: found mon.noname-b 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e640a7360 con 0x7f2e64139450 2024-09-11T02:05:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2e54001750 con 0x7f2e64139450 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: dump: 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.650 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e6b69b640 5 monclient: authenticate success, global_id 134894 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e6b69b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e54001970 con 0x7f2e64139450 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 1 -- 172.21.15.73:0/562896166 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2e54004be0 con 0x7f2e64139450 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e5bfff640 10 monclient: dump: 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.653 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e6b69b640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.646+0000 7f2e6b69b640 4 set_mon_vals no callback set 2024-09-11T02:05:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.647+0000 7f2e6b69b640 10 monclient: shutdown 2024-09-11T02:05:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.647+0000 7f2e6b69b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.647+0000 7f2e6b69b640 1 -- 172.21.15.73:0/562896166 >> v1:172.21.15.73:6790/0 conn(0x7f2e64139450 legacy=0x7f2e6413df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.647+0000 7f2e6b69b640 1 -- 172.21.15.73:0/562896166 shutdown_connections 2024-09-11T02:05:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.647+0000 7f2e6b69b640 1 -- 172.21.15.73:0/562896166 >> 172.21.15.73:0/562896166 conn(0x7f2e640a8050 msgr2=0x7f2e640a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.648+0000 7f2e6b69b640 1 -- 172.21.15.73:0/562896166 shutdown_connections 2024-09-11T02:05:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.648+0000 7f2e6b69b640 1 -- 172.21.15.73:0/562896166 wait complete. 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.648+0000 7f2e6b69b640 10 monclient: build_initial_monmap 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 10 monclient: monmap: 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 1 Processor -- start 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 1 -- start start 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 10 monclient: init 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 10 monclient: _add_conns ranks=[1,5,2,8,3,6,4,0,7] 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 10 monclient(hunting): picked mon.noname-f con 0x7f2e64139450 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 10 monclient(hunting): picked mon.noname-h con 0x7f2e6413f620 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 10 monclient(hunting): picked mon.noname-b con 0x7f2e6413e850 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6406e980 con 0x7f2e64139450 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6413cc10 con 0x7f2e6413e850 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e641cda80 con 0x7f2e6413f620 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.649+0000 7f2e6b69b640 10 monclient(hunting): authenticate will time out at 1144.253926s 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e69c38640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f2e6413e850 0x7f2e641d5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41828/0 (socket says 172.21.15.73:41828) 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e69c38640 1 -- 172.21.15.73:0/680163238 learned_addr learned my addr 172.21.15.73:0/680163238 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016095529 0 0) 0x7f2e6413cc10 con 0x7f2e6413e850 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): my global_id is 134903 2024-09-11T02:05:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e48003520 con 0x7f2e6413e850 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418849622 0 0) 0x7f2e50003520 con 0x7f2e64139450 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): my global_id is 144181 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6413cc10 con 0x7f2e64139450 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3451187433 0 0) 0x7f2e641cda80 con 0x7f2e6413f620 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): my global_id is 144185 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e50003520 con 0x7f2e6413f620 2024-09-11T02:05:02.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2060199808 0 0) 0x7f2e48003520 con 0x7f2e6413e850 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e641cda80 con 0x7f2e6413e850 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2e5c001da0 con 0x7f2e6413e850 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): dump: 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3629514419 0 0) 0x7f2e6413cc10 con 0x7f2e64139450 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e48003520 con 0x7f2e64139450 2024-09-11T02:05:02.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1204905242 0 0) 0x7f2e50003520 con 0x7f2e6413f620 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e6413cc10 con 0x7f2e6413f620 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2e60001a70 con 0x7f2e64139450 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): dump: 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.665 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2e540016d0 con 0x7f2e6413f620 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient(hunting): dump: 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.666 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.667 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2883703173 0 0) 0x7f2e641cda80 con 0x7f2e6413e850 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 >> v1:172.21.15.203:6791/0 conn(0x7f2e6413f620 legacy=0x7f2e641d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 >> v1:172.21.15.203:6789/0 conn(0x7f2e64139450 legacy=0x7f2e6413e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 monclient: found mon.b 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e640a1e50 con 0x7f2e6413e850 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient: _finish_auth 0 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e6b69b640 5 monclient: authenticate success, global_id 134903 2024-09-11T02:05:02.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e6b69b640 10 monclient: _renew_subs 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e6b69b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6413c370 con 0x7f2e6413e850 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e5c002020 con 0x7f2e6413e850 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f2e5c003f80 con 0x7f2e6413e850 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e59ffb640 10 monclient: dump: 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:02.669 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.650+0000 7f2e5b7fe640 4 set_mon_vals no callback set 2024-09-11T02:05:02.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.651+0000 7f2e6b69b640 10 monclient: _renew_subs 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.651+0000 7f2e6b69b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.651+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e640a13c0 con 0x7f2e6413e850 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.651+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f2e5c004120 con 0x7f2e6413e850 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.652+0000 7f2e6b69b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.652+0000 7f2e6b69b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.652+0000 7f2e6b69b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.652+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e64141110 con 0x7f2e6413e850 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.652+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f2e5c04e4f0 con 0x7f2e6413e850 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.652+0000 7f2e69437640 10 monclient: get_auth_request con 0x7f2e480407c0 auth_method 0 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.656+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f2e5c017830 con 0x7f2e6413e850 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.656+0000 7f2e59ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:02.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.656+0000 7f2e59ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.905+0000 7f2e6b69b640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-11T02:05:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.905+0000 7f2e6b69b640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-11T02:05:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.905+0000 7f2e6b69b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:02.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.905+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f2e64074820 con 0x7f2e6413e850 2024-09-11T02:05:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.907+0000 7f2e59ffb640 1 -- 172.21.15.73:0/680163238 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f2e5c017130 con 0x7f2e6413e850 2024-09-11T02:05:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.907+0000 7f2e59ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-11T02:05:02.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.907+0000 7f2e59ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:02.912 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.912 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=11,logm=59} crc {auth=1206483826,config=2586702516,health=2280293284,kv=3851717427,logm=505437763}) 2024-09-11T02:05:02.912 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=21,config=2,health=11,kv=11,logm=55} crc {auth=877038786,config=2586702516,health=2725660739,kv=3075781660,logm=246209503}) 2024-09-11T02:05:02.912 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.912 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=11,logm=59} crc {auth=1206483826,config=2586702516,health=2280293284,kv=3851717427,logm=505437763}) 2024-09-11T02:05:02.912 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=80489818,config=2586702516,health=3790566575,kv=691542103,logm=1207064000}) 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=11,logm=59} crc {auth=1206483826,config=2586702516,health=2280293284,kv=3851717427,logm=505437763}) 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=20,config=2,health=12,kv=12,logm=54} crc {auth=2216148071,config=2586702516,health=3790566575,kv=691542103,logm=4092396910}) 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=11,logm=59} crc {auth=1206483826,config=2586702516,health=2280293284,kv=3851717427,logm=505437763}) 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=21,config=2,health=11,kv=12,logm=54} crc {auth=2010603150,config=2586702516,health=2992602962,kv=691542103,logm=2762612447}) 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=11,logm=59} crc {auth=1206483826,config=2586702516,health=2280293284,kv=3851717427,logm=505437763}) 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=19,config=2,health=11,kv=12,logm=56} crc {auth=1791813842,config=2586702516,health=2992602962,kv=691542103,logm=2891552983}) 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=11,logm=59} crc {auth=1206483826,config=2586702516,health=2280293284,kv=3851717427,logm=505437763}) 2024-09-11T02:05:02.913 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=20,config=2,health=12,kv=12,logm=54} crc {auth=2632158979,config=2586702516,health=3790566575,kv=691542103,logm=953797033}) 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=11,logm=59} crc {auth=1206483826,config=2586702516,health=2280293284,kv=3851717427,logm=505437763}) 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=20,config=2,health=12,kv=11,logm=55} crc {auth=2216148071,config=575665002,health=1549905381,kv=3966509842,logm=2274876045}) 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=10,kv=11,logm=59} crc {auth=1206483826,config=2586702516,health=2280293284,kv=3851717427,logm=505437763}) 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.907+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=19,config=2,health=12,kv=11,logm=56} crc {auth=3161313385,config=2586702516,health=3790566575,kv=1804836143,logm=962435987}) 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539822588}) 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1033880432}) 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539822588}) 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3927007750}) 2024-09-11T02:05:02.914 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539822588}) 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=709830272}) 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539822588}) 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3337860649}) 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539822588}) 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1741829903}) 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539822588}) 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2323366213}) 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.915 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539822588}) 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1099833972}) 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.908+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2539822588}) 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.909+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=355465511}) 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082535954}) 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=683278302}) 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082535954}) 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1631356925}) 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.916 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082535954}) 2024-09-11T02:05:02.917 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3554077843}) 2024-09-11T02:05:02.917 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.910+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 >> v1:172.21.15.203:6812/2311533528 conn(0x7f2e480407c0 legacy=0x7f2e48042c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.917 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082535954}) 2024-09-11T02:05:02.917 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2618711435}) 2024-09-11T02:05:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.910+0000 7f2e6b69b640 10 monclient: shutdown 2024-09-11T02:05:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.910+0000 7f2e6b69b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:02.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.910+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 >> v1:172.21.15.73:6790/0 conn(0x7f2e6413e850 legacy=0x7f2e641d5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:02.919 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.919 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082535954}) 2024-09-11T02:05:02.919 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3454124843}) 2024-09-11T02:05:02.919 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.919 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082535954}) 2024-09-11T02:05:02.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.910+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 shutdown_connections 2024-09-11T02:05:02.919 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1927479636}) 2024-09-11T02:05:02.920 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.910+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 >> 172.21.15.73:0/680163238 conn(0x7f2e640a8050 msgr2=0x7f2e640a9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:02.920 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082535954}) 2024-09-11T02:05:02.921 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=639019688}) 2024-09-11T02:05:02.921 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.921 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1082535954}) 2024-09-11T02:05:02.921 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.910+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1139120761}) 2024-09-11T02:05:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.910+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 shutdown_connections 2024-09-11T02:05:02.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:02.910+0000 7f2e6b69b640 1 -- 172.21.15.73:0/680163238 wait complete. 2024-09-11T02:05:02.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221689485}) 2024-09-11T02:05:02.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2821795029}) 2024-09-11T02:05:02.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221689485}) 2024-09-11T02:05:02.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1069541816}) 2024-09-11T02:05:02.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221689485}) 2024-09-11T02:05:02.942 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2739795541}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221689485}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1691236054}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221689485}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3993008223}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221689485}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3217483396}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221689485}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3394550260}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2221689485}) 2024-09-11T02:05:02.943 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.911+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=208770045}) 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016827244}) 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3903832749}) 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016827244}) 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=64730530}) 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016827244}) 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2348686141}) 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016827244}) 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1916902298}) 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.944 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016827244}) 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3705979779}) 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016827244}) 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2514425176}) 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016827244}) 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1108879654}) 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016827244}) 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.912+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3042205427}) 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.913+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.913+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880997291}) 2024-09-11T02:05:02.945 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.913+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3523067435}) 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.913+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.913+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880997291}) 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.913+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3591641825}) 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.913+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.913+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880997291}) 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.913+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3846012647}) 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880997291}) 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=968886826}) 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880997291}) 2024-09-11T02:05:02.946 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1979288353}) 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880997291}) 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4081495167}) 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880997291}) 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3595911391}) 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2880997291}) 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.914+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3924450917}) 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372882524}) 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=158643174}) 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.947 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372882524}) 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4189980312}) 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372882524}) 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1460700644}) 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372882524}) 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1718064288}) 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372882524}) 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=275599258}) 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372882524}) 2024-09-11T02:05:02.948 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=771049478}) 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372882524}) 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4005110975}) 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372882524}) 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.915+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=53359716}) 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343732207}) 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2726592380}) 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343732207}) 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1270547918}) 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.949 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343732207}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1872669418}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343732207}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=977243350}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343732207}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2940262472}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343732207}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=958861198}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343732207}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3172350369}) 2024-09-11T02:05:02.950 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343732207}) 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.916+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3857292260}) 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421342040}) 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1280998697}) 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421342040}) 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3508607401}) 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421342040}) 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2905016593}) 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421342040}) 2024-09-11T02:05:02.951 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.917+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2495136954}) 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421342040}) 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2722932108}) 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421342040}) 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1774225343}) 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421342040}) 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2958538837}) 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2421342040}) 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.918+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3680056020}) 2024-09-11T02:05:02.952 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10743953}) 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=690369396}) 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10743953}) 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3241312697}) 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10743953}) 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3777264059}) 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10743953}) 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2998907039}) 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.953 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10743953}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=261056190}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10743953}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2273006110}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10743953}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1613457436}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=10743953}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.919+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2604092990}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051555880}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1320581912}) 2024-09-11T02:05:02.954 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051555880}) 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=985600654}) 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051555880}) 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2972391238}) 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051555880}) 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3980639318}) 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051555880}) 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3649487050}) 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.955 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051555880}) 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4150344204}) 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051555880}) 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=899837941}) 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051555880}) 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.920+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1464383302}) 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20651624}) 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2793621868}) 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20651624}) 2024-09-11T02:05:02.956 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3592818239}) 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20651624}) 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1689405352}) 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20651624}) 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3298769421}) 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20651624}) 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3606235639}) 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20651624}) 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3675554709}) 2024-09-11T02:05:02.957 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20651624}) 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3086615265}) 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20651624}) 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.921+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2159400260}) 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4028351530}) 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4031473393}) 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4028351530}) 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3473027915}) 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.958 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4028351530}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4006707188}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4028351530}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2725244898}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4028351530}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1146431372}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4028351530}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3466608153}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4028351530}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1160122145}) 2024-09-11T02:05:02.959 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4028351530}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.922+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1780258990}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=166275999}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2417926015}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=166275999}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3637146156}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=166275999}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2406121981}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=166275999}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=525015947}) 2024-09-11T02:05:02.960 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=166275999}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=482160572}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=166275999}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=557533015}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.923+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=166275999}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.924+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=783103402}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.924+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.924+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=166275999}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.924+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1558117257}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403307615}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=853994378}) 2024-09-11T02:05:02.961 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403307615}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=398978919}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403307615}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=773648247}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403307615}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2493514070}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403307615}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=104873365}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403307615}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3378497514}) 2024-09-11T02:05:02.962 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.963 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403307615}) 2024-09-11T02:05:02.963 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1455982990}) 2024-09-11T02:05:02.963 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.963 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2403307615}) 2024-09-11T02:05:02.963 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.925+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=453276781}) 2024-09-11T02:05:02.964 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2881673383}) 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1888264410}) 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2881673383}) 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4179462963}) 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2881673383}) 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3819381642}) 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2881673383}) 2024-09-11T02:05:02.983 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2554142383}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2881673383}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4106249090}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2881673383}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1702125591}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2881673383}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3819075611}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2881673383}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.926+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3350266827}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182274222}) 2024-09-11T02:05:02.984 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=54221994}) 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182274222}) 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3145547879}) 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182274222}) 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=293971382}) 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182274222}) 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=12048629}) 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182274222}) 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1891405699}) 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.927+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.985 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.928+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182274222}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.928+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3500514747}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.928+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.928+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182274222}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.928+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3132183258}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.928+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.928+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1182274222}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.928+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2873919264}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664715209}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2961770078}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664715209}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2853223711}) 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.986 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664715209}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=185942684}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664715209}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4245493164}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664715209}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3549826262}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664715209}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1880769627}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664715209}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1451523046}) 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.987 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3664715209}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.929+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3539162225}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3757477361}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=488659797}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3757477361}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1406887836}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3757477361}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2516812358}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3757477361}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4215917928}) 2024-09-11T02:05:02.988 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3757477361}) 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2033489425}) 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3757477361}) 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1203470047}) 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3757477361}) 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=790811795}) 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3757477361}) 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.930+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3424849223}) 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.989 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711457874}) 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2197149987}) 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711457874}) 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1183141722}) 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711457874}) 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3780061284}) 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711457874}) 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=862813519}) 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711457874}) 2024-09-11T02:05:02.990 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1305422197}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711457874}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1416544503}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711457874}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=406142242}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=711457874}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.931+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1010751205}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016853519}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2654762448}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016853519}) 2024-09-11T02:05:02.991 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4181248206}) 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016853519}) 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3185064897}) 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016853519}) 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2976503333}) 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016853519}) 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1843765772}) 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016853519}) 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3322967731}) 2024-09-11T02:05:02.992 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016853519}) 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3262252211}) 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016853519}) 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.932+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1066356171}) 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.933+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.933+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321193045}) 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.933+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1669793229}) 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.933+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.933+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321193045}) 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.933+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1249636860}) 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321193045}) 2024-09-11T02:05:02.993 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3964998745}) 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321193045}) 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2727771917}) 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321193045}) 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3542164242}) 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321193045}) 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1501013161}) 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321193045}) 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2570433732}) 2024-09-11T02:05:02.994 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321193045}) 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.934+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1602192625}) 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3214279977}) 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3113847290}) 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3214279977}) 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1533559076}) 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3214279977}) 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3438763387}) 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.995 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3214279977}) 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=107300138}) 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3214279977}) 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1901866}) 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3214279977}) 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2405318958}) 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3214279977}) 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3272058685}) 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3214279977}) 2024-09-11T02:05:02.996 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.935+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3766162313}) 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1339698314,mdsmap=1237235235,mgr=2803746334,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=650074086,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=4022202180}) 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=44} crc {logm=1339698314,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=386759338,monmap=2295470326,nvmeofgw=1596038039,osd_metadata=977368212,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=3776824910}) 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1339698314,mdsmap=1237235235,mgr=2803746334,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=650074086,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=4022202180}) 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=44} crc {logm=1339698315,mdsmap=3149052893,mgr=1325526047,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=4091866,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=295350990}) 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1339698314,mdsmap=1237235235,mgr=2803746334,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=650074086,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=4022202180}) 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1339698314,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=1089945180,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=2144199961}) 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1339698314,mdsmap=1237235235,mgr=2803746334,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=650074086,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=4022202180}) 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=5,mdsmap=2,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=16,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=48} crc {logm=1339698314,mdsmap=3140514009,mgr=3564766123,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2879099695,mon_config_key=431054317,monmap=2141158591,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=914701464}) 2024-09-11T02:05:02.997 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.936+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1339698314,mdsmap=1237235235,mgr=2803746334,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=650074086,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=4022202180}) 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=4,mdsmap=1,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=46} crc {logm=2257494767,mdsmap=3496438518,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2426107848,mon_config_key=386759338,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=818430832}) 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1339698314,mdsmap=1237235235,mgr=2803746334,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=650074086,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=4022202180}) 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=4,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=48} crc {logm=4113696044,mdsmap=1602321297,mgr=1325526047,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2879099695,mon_config_key=2505039626,monmap=2295470326,nvmeofgw=598337686,osd_metadata=925954136,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=1586091680}) 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1339698314,mdsmap=1237235235,mgr=2803746334,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=650074086,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=4022202180}) 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=5,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=2,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=44} crc {logm=1339698314,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=2649521902,monmap=2141158591,nvmeofgw=3140514009,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=962866881}) 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=5,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=17,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=43} crc {logm=1339698314,mdsmap=1237235235,mgr=2803746334,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=650074086,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_pg_creating=2813046499,osd_snap=4133920409,osdmap=4022202180}) 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.937+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=4,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_snap=2,osdmap=45} crc {logm=2257494767,mdsmap=3149052893,mgr=25274659,mgr_command_descs=3192186153,mgr_metadata=1396927942,mgrstat=2041889467,mon_config_key=1518386119,monmap=2295470326,nvmeofgw=598337686,osd_metadata=1227001357,osd_snap=4133920409,osdmap=1216337418}) 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.998 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=56021085}) 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3626349491}) 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=56021085}) 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1206166373}) 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=56021085}) 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3706937408}) 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=56021085}) 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1716361751}) 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=56021085}) 2024-09-11T02:05:02.999 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3427461398}) 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=56021085}) 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=12684219}) 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.938+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=56021085}) 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2884073814}) 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=56021085}) 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=615518815}) 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=18} crc {osdmap=2871199911}) 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=18} crc {osdmap=2871199912}) 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.000 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=18} crc {osdmap=2871199911}) 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=16} crc {osdmap=2080729728}) 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=18} crc {osdmap=2871199911}) 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=14} crc {osdmap=4222612540}) 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=18} crc {osdmap=2871199911}) 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=16} crc {osdmap=2953898844}) 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=18} crc {osdmap=2871199911}) 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=17} crc {osdmap=1651207418}) 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=18} crc {osdmap=2871199911}) 2024-09-11T02:05:03.001 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=16} crc {osdmap=698058906}) 2024-09-11T02:05:03.002 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-11T02:05:03.002 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.939+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=18} crc {osdmap=2871199911}) 2024-09-11T02:05:03.002 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-11T02:05:02.940+0000 7fe648543640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=17} crc {osdmap=4032384861}) 2024-09-11T02:05:03.964 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-11T02:05:03.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T02:05:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.069+0000 7f6ca8d53640 10 monclient: get_monmap_and_config 2024-09-11T02:05:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.069+0000 7f6ca8d53640 10 monclient: build_initial_monmap 2024-09-11T02:05:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.069+0000 7f6ca8d53640 10 monclient: monmap: 2024-09-11T02:05:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:04.070577+0000 2024-09-11T02:05:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:04.070577+0000 2024-09-11T02:05:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:04.072 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 1 Processor -- start 2024-09-11T02:05:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 1 -- start start 2024-09-11T02:05:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 10 monclient: init 2024-09-11T02:05:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 10 monclient: _add_conns ranks=[3,2,5,7,8,4,0,1,6] 2024-09-11T02:05:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 10 monclient(hunting): picked mon.noname-g con 0x7f6ca40a5b30 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 10 monclient(hunting): picked mon.noname-b con 0x7f6ca40a6620 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 10 monclient(hunting): picked mon.noname-h con 0x7f6ca409db70 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca40a7490 con 0x7f6ca40a6620 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca409ca00 con 0x7f6ca40a5b30 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca406fbf0 con 0x7f6ca409db70 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.070+0000 7f6ca8d53640 10 monclient(hunting): authenticate will time out at 1145.674915s 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6c99d9b640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f6ca40a6620 0x7f6ca413dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41834/0 (socket says 172.21.15.73:41834) 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6c99d9b640 1 -- 172.21.15.73:0/486499559 learned_addr learned my addr 172.21.15.73:0/486499559 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234537446 0 0) 0x7f6ca40a7490 con 0x7f6ca40a6620 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): my global_id is 134912 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c90003520 con 0x7f6ca40a6620 2024-09-11T02:05:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722856783 0 0) 0x7f6ca409ca00 con 0x7f6ca40a5b30 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): my global_id is 6573 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca40a7490 con 0x7f6ca40a5b30 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318245247 0 0) 0x7f6ca406fbf0 con 0x7f6ca409db70 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient(hunting): my global_id is 144194 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca409ca00 con 0x7f6ca409db70 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 340325904 0 0) 0x7f6c90003520 con 0x7f6ca40a6620 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 >> v1:172.21.15.203:6791/0 conn(0x7f6ca409db70 legacy=0x7f6ca4141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 >> v1:172.21.15.203:6790/0 conn(0x7f6ca40a5b30 legacy=0x7f6ca40a5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: _finish_hunting 0 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 monclient: found mon.noname-b 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca409ceb0 con 0x7f6ca40a6620 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: _finish_auth 0 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: _check_auth_tickets 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c8c001830 con 0x7f6ca40a6620 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca8d53640 5 monclient: authenticate success, global_id 134912 2024-09-11T02:05:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca8d53640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: dump: 2024-09-11T02:05:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.085 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.086 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.086 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.086 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.086 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.086 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.086 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca8d53640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c8c001a50 con 0x7f6ca40a6620 2024-09-11T02:05:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 1 -- 172.21.15.73:0/486499559 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c8c004be0 con 0x7f6ca40a6620 2024-09-11T02:05:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca8d53640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca8d53640 4 set_mon_vals no callback set 2024-09-11T02:05:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:04.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.071+0000 7f6ca1d9b640 10 monclient: dump: 2024-09-11T02:05:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.088 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.089 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.089 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.089 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.089 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.089 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.089 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.089 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.090 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.090 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.072+0000 7f6ca8d53640 10 monclient: shutdown 2024-09-11T02:05:04.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.072+0000 7f6ca8d53640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:04.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.072+0000 7f6ca8d53640 1 -- 172.21.15.73:0/486499559 >> v1:172.21.15.73:6790/0 conn(0x7f6ca40a6620 legacy=0x7f6ca413dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.072+0000 7f6ca8d53640 1 -- 172.21.15.73:0/486499559 shutdown_connections 2024-09-11T02:05:04.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.072+0000 7f6ca8d53640 1 -- 172.21.15.73:0/486499559 >> 172.21.15.73:0/486499559 conn(0x7f6ca40abe30 msgr2=0x7f6ca40a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:04.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.072+0000 7f6ca8d53640 1 -- 172.21.15.73:0/486499559 shutdown_connections 2024-09-11T02:05:04.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.072+0000 7f6ca8d53640 1 -- 172.21.15.73:0/486499559 wait complete. 2024-09-11T02:05:04.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.072+0000 7f6ca8d53640 10 monclient: build_initial_monmap 2024-09-11T02:05:04.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.072+0000 7f6ca8d53640 10 monclient: monmap: 2024-09-11T02:05:04.091 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:04.092 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 1 Processor -- start 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 1 -- start start 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 10 monclient: init 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 10 monclient: _add_conns ranks=[2,5,4,6,7,3,0,1,8] 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 10 monclient(hunting): picked mon.noname-b con 0x7f6ca40a5b30 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 10 monclient(hunting): picked mon.noname-h con 0x7f6ca40a6620 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 10 monclient(hunting): picked mon.noname-c con 0x7f6ca41d3ac0 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:04.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca4129160 con 0x7f6ca40a5b30 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca41261f0 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca40a5040 con 0x7f6ca40a6620 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.073+0000 7f6ca8d53640 10 monclient(hunting): authenticate will time out at 1145.677970s 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca259c640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f6ca40a5b30 0x7f6ca41253d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41840/0 (socket says 172.21.15.73:41840) 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca259c640 1 -- 172.21.15.73:0/3156550484 learned_addr learned my addr 172.21.15.73:0/3156550484 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224382815 0 0) 0x7f6ca4129160 con 0x7f6ca40a5b30 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): my global_id is 134921 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c84003520 con 0x7f6ca40a5b30 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622074863 0 0) 0x7f6ca41261f0 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): my global_id is 6430 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca4129160 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1537662522 0 0) 0x7f6ca40a5040 con 0x7f6ca40a6620 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): my global_id is 144203 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ca41261f0 con 0x7f6ca40a6620 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3977699092 0 0) 0x7f6ca4129160 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ca40a5040 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c9c001e10 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.096 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1075933375 0 0) 0x7f6c84003520 con 0x7f6ca40a5b30 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ca4129160 con 0x7f6ca40a5b30 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c94001ab0 con 0x7f6ca40a5b30 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.097 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.098 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.5 v1:172.21.15.203:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 758947544 0 0) 0x7f6ca41261f0 con 0x7f6ca40a6620 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.203:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c84003520 con 0x7f6ca40a6620 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.5 v1:172.21.15.203:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c8c001c00 con 0x7f6ca40a6620 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.099 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3840249336 0 0) 0x7f6ca40a5040 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 >> v1:172.21.15.203:6791/0 conn(0x7f6ca40a6620 legacy=0x7f6ca4125ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 >> v1:172.21.15.73:6790/0 conn(0x7f6ca40a5b30 legacy=0x7f6ca41253d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 monclient: found mon.c 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca406ea10 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca8d53640 5 monclient: authenticate success, global_id 6430 2024-09-11T02:05:04.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca8d53640 10 monclient: _renew_subs 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca8d53640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca41282f0 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca8d53640 10 monclient: _renew_subs 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca8d53640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ca4128e80 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c9c003c40 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6c9c004130 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6c9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.074+0000 7f6ca159a640 4 set_mon_vals no callback set 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.075+0000 7f6c9b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.075+0000 7f6c9b7fe640 10 monclient: dump: 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.102 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.075+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f6c9c010870 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.075+0000 7f6ca8d53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.075+0000 7f6ca8d53640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.075+0000 7f6ca8d53640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.075+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c88005080 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.076+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f6c9c04d260 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.076+0000 7f6ca259c640 10 monclient: get_auth_request con 0x7f6c840406c0 auth_method 0 2024-09-11T02:05:04.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.081+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f6c9c0166e0 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.081+0000 7f6c9b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:04.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.081+0000 7f6c9b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.323+0000 7f6ca8d53640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-11T02:05:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.323+0000 7f6ca8d53640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-11T02:05:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.323+0000 7f6ca8d53640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.323+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6c88005370 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.323+0000 7f6c9b7fe640 1 -- 172.21.15.73:0/3156550484 <== mon.4 v1:172.21.15.73:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 2789905979) 0x7f6c9c015fe0 con 0x7f6ca41d3ac0 2024-09-11T02:05:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.323+0000 7f6c9b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-11T02:05:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.323+0000 7f6c9b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:04.325 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":52,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","modified":"2024-09-11T01:57:30.356953Z","created":"2024-09-11T01:57:30.356953Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6790","nonce":0}]},"addr":"172.21.15.73:6790/0","public_addr":"172.21.15.73:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6790","nonce":0}]},"addr":"172.21.15.203:6790/0","public_addr":"172.21.15.203:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6791","nonce":0}]},"addr":"172.21.15.73:6791/0","public_addr":"172.21.15.73:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6791","nonce":0}]},"addr":"172.21.15.203:6791/0","public_addr":"172.21.15.203:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6792","nonce":0}]},"addr":"172.21.15.73:6792/0","public_addr":"172.21.15.73:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6792","nonce":0}]},"addr":"172.21.15.203:6792/0","public_addr":"172.21.15.203:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6793","nonce":0}]},"addr":"172.21.15.73:6793/0","public_addr":"172.21.15.73:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T02:05:04.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.325+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 >> v1:172.21.15.203:6812/2311533528 conn(0x7f6c840406c0 legacy=0x7f6c84042b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.325+0000 7f6ca8d53640 10 monclient: shutdown 2024-09-11T02:05:04.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.325+0000 7f6ca8d53640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:04.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.325+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 >> v1:172.21.15.73:6791/0 conn(0x7f6ca41d3ac0 legacy=0x7f6ca41d5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.325+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 shutdown_connections 2024-09-11T02:05:04.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.325+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 >> 172.21.15.73:0/3156550484 conn(0x7f6ca409db70 msgr2=0x7f6ca4142400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:04.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.325+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 shutdown_connections 2024-09-11T02:05:04.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.325+0000 7f6ca8d53640 1 -- 172.21.15.73:0/3156550484 wait complete. 2024-09-11T02:05:04.337 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-11T02:05:04.337 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T02:05:04.349 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T02:05:04.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T02:05:04.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.445+0000 7f68aa1a0640 10 monclient: get_monmap_and_config 2024-09-11T02:05:04.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.445+0000 7f68aa1a0640 10 monclient: build_initial_monmap 2024-09-11T02:05:04.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.445+0000 7f68aa1a0640 10 monclient: monmap: 2024-09-11T02:05:04.447 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:04.447 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:04.446632+0000 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:04.446632+0000 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:04.449 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:04.449 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.446+0000 7f68aa1a0640 1 Processor -- start 2024-09-11T02:05:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.446+0000 7f68aa1a0640 1 -- start start 2024-09-11T02:05:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.446+0000 7f68aa1a0640 10 monclient: init 2024-09-11T02:05:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.446+0000 7f68aa1a0640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.446+0000 7f68aa1a0640 10 monclient: _add_conns ranks=[4,8,5,1,3,6,7,2,0] 2024-09-11T02:05:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.446+0000 7f68aa1a0640 10 monclient(hunting): picked mon.noname-c con 0x7f68a40745f0 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 10 monclient(hunting): picked mon.noname-e con 0x7f68a40a1740 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 10 monclient(hunting): picked mon.noname-h con 0x7f68a413f2a0 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a40a5740 con 0x7f68a40745f0 2024-09-11T02:05:04.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a40750e0 con 0x7f68a413f2a0 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a40a0a90 con 0x7f68a40a1740 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 10 monclient(hunting): authenticate will time out at 1146.051066s 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a2ffd640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f68a40a1740 0x7f68a413db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35154/0 (socket says 172.21.15.73:35154) 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a2ffd640 1 -- 172.21.15.73:0/4223919785 learned_addr learned my addr 172.21.15.73:0/4223919785 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023915284 0 0) 0x7f68a40a5740 con 0x7f68a40745f0 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient(hunting): my global_id is 6439 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f688c003520 con 0x7f68a40745f0 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67341437 0 0) 0x7f68a40a0a90 con 0x7f68a40a1740 2024-09-11T02:05:04.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient(hunting): my global_id is 115721 2024-09-11T02:05:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a40a5740 con 0x7f68a40a1740 2024-09-11T02:05:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 707953822 0 0) 0x7f68a40a5740 con 0x7f68a40a1740 2024-09-11T02:05:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 >> v1:172.21.15.203:6791/0 conn(0x7f68a413f2a0 legacy=0x7f68a4141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 >> v1:172.21.15.73:6791/0 conn(0x7f68a40745f0 legacy=0x7f68a40749d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: _finish_hunting 0 2024-09-11T02:05:04.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 monclient: found mon.noname-e 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a40a0d70 con 0x7f68a40a1740 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: _finish_auth 0 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: _check_auth_tickets 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6898001810 con 0x7f68a40a1740 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: dump: 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.461 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 5 monclient: authenticate success, global_id 115721 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6898001a30 con 0x7f68a40a1740 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 1 -- 172.21.15.73:0/4223919785 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6898004be0 con 0x7f68a40a1740 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68aa1a0640 4 set_mon_vals no callback set 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.447+0000 7f68a27fc640 10 monclient: dump: 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.463 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.464 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.465 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.448+0000 7f68aa1a0640 10 monclient: shutdown 2024-09-11T02:05:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.448+0000 7f68aa1a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.448+0000 7f68aa1a0640 1 -- 172.21.15.73:0/4223919785 >> v1:172.21.15.73:6793/0 conn(0x7f68a40a1740 legacy=0x7f68a413db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.448+0000 7f68aa1a0640 1 -- 172.21.15.73:0/4223919785 shutdown_connections 2024-09-11T02:05:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.448+0000 7f68aa1a0640 1 -- 172.21.15.73:0/4223919785 >> 172.21.15.73:0/4223919785 conn(0x7f68a40a9ca0 msgr2=0x7f68a40a5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:04.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.448+0000 7f68aa1a0640 1 -- 172.21.15.73:0/4223919785 shutdown_connections 2024-09-11T02:05:04.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.448+0000 7f68aa1a0640 1 -- 172.21.15.73:0/4223919785 wait complete. 2024-09-11T02:05:04.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.448+0000 7f68aa1a0640 10 monclient: build_initial_monmap 2024-09-11T02:05:04.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.448+0000 7f68aa1a0640 10 monclient: monmap: 2024-09-11T02:05:04.466 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:04.466 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:04.466 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:04.466 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 1 Processor -- start 2024-09-11T02:05:04.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 1 -- start start 2024-09-11T02:05:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 10 monclient: init 2024-09-11T02:05:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 10 monclient: _add_conns ranks=[1,4,6,0,5,8,2,7,3] 2024-09-11T02:05:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 10 monclient(hunting): picked mon.noname-f con 0x7f68a40a1740 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 10 monclient(hunting): picked mon.noname-c con 0x7f68a413f2a0 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 10 monclient(hunting): picked mon.noname-d con 0x7f68a4124b70 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a40a2150 con 0x7f68a40a1740 2024-09-11T02:05:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a4125f70 con 0x7f68a413f2a0 2024-09-11T02:05:04.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a4126250 con 0x7f68a4124b70 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68aa1a0640 10 monclient(hunting): authenticate will time out at 1146.053887s 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68a2ffd640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f68a413f2a0 0x7f68a41d2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40386/0 (socket says 172.21.15.73:40386) 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.449+0000 7f68a2ffd640 1 -- 172.21.15.73:0/3528134974 learned_addr learned my addr 172.21.15.73:0/3528134974 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615017014 0 0) 0x7f68a4125f70 con 0x7f68a413f2a0 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): my global_id is 6448 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6890003520 con 0x7f68a413f2a0 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359833281 0 0) 0x7f68a4126250 con 0x7f68a4124b70 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): my global_id is 115701 2024-09-11T02:05:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a4125f70 con 0x7f68a4124b70 2024-09-11T02:05:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4275139931 0 0) 0x7f6890003520 con 0x7f68a413f2a0 2024-09-11T02:05:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68a4126250 con 0x7f68a413f2a0 2024-09-11T02:05:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1795739418 0 0) 0x7f68940013a0 con 0x7f68a40a1740 2024-09-11T02:05:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): my global_id is 144190 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6890003520 con 0x7f68a40a1740 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6898004b20 con 0x7f68a413f2a0 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): dump: 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.471 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4133334043 0 0) 0x7f68a4125f70 con 0x7f68a4124b70 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68940013a0 con 0x7f68a4124b70 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f689c0018b0 con 0x7f68a4124b70 2024-09-11T02:05:04.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient(hunting): dump: 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3943116861 0 0) 0x7f68a4126250 con 0x7f68a413f2a0 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 >> v1:172.21.15.73:6792/0 conn(0x7f68a4124b70 legacy=0x7f68a41d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 >> v1:172.21.15.203:6789/0 conn(0x7f68a40a1740 legacy=0x7f68a413e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient: _finish_hunting 0 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 monclient: found mon.c 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:04.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a4073a60 con 0x7f68a413f2a0 2024-09-11T02:05:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient: _finish_auth 0 2024-09-11T02:05:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient: _check_auth_tickets 2024-09-11T02:05:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f68aa1a0640 5 monclient: authenticate success, global_id 6448 2024-09-11T02:05:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f68aa1a0640 10 monclient: _renew_subs 2024-09-11T02:05:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f68aa1a0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68a41259b0 con 0x7f68a413f2a0 2024-09-11T02:05:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f68aa1a0640 10 monclient: _renew_subs 2024-09-11T02:05:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f68aa1a0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f68a413ef00 con 0x7f68a413f2a0 2024-09-11T02:05:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68980011b0 con 0x7f68a413f2a0 2024-09-11T02:05:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6898001970 con 0x7f68a413f2a0 2024-09-11T02:05:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f68a1ffb640 4 set_mon_vals no callback set 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.450+0000 7f688bfff640 10 monclient: dump: 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.451+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f6898011780 con 0x7f68a413f2a0 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.451+0000 7f68aa1a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.451+0000 7f68aa1a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.451+0000 7f68aa1a0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.451+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6884005080 con 0x7f68a413f2a0 2024-09-11T02:05:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.451+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f689804e4e0 con 0x7f68a413f2a0 2024-09-11T02:05:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.451+0000 7f68a37fe640 10 monclient: get_auth_request con 0x7f68900404a0 auth_method 0 2024-09-11T02:05:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.456+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f6898017880 con 0x7f68a413f2a0 2024-09-11T02:05:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.456+0000 7f688bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.456+0000 7f688bfff640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:04.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.630+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6884000b90 con 0x7f68900404a0 2024-09-11T02:05:04.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.631+0000 7f688bfff640 1 -- 172.21.15.73:0/3528134974 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34090 (unknown 2965378022 0 2111474679) 0x7f6884000b90 con 0x7f68900404a0 2024-09-11T02:05:04.633 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T02:05:04.634 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-11T02:05:04.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.633+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 >> v1:172.21.15.203:6812/2311533528 conn(0x7f68900404a0 legacy=0x7f6890042960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.633+0000 7f68aa1a0640 10 monclient: shutdown 2024-09-11T02:05:04.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.633+0000 7f68aa1a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:04.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.633+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 >> v1:172.21.15.73:6791/0 conn(0x7f68a413f2a0 legacy=0x7f68a41d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.633+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 shutdown_connections 2024-09-11T02:05:04.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.633+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 >> 172.21.15.73:0/3528134974 conn(0x7f68a40745f0 msgr2=0x7f68a4076460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:04.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.633+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 shutdown_connections 2024-09-11T02:05:04.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.633+0000 7f68aa1a0640 1 -- 172.21.15.73:0/3528134974 wait complete. 2024-09-11T02:05:04.645 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":515,"stamp":"2024-09-11T02:05:02.962122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":190292,"kb_used_data":7304,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566040748,"statfs":{"total":579820584960,"available":579625725952,"internally_reserved":0,"allocated":7479296,"data_stored":3723654,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9567,"internal_metadata":187226785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.317138"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":605,"reported_epoch":315,"state":"active+clean","last_fresh":"2024-09-11T02:04:59.648864+0000","last_change":"2024-09-11T01:58:28.988312+0000","last_active":"2024-09-11T02:04:59.648864+0000","last_peered":"2024-09-11T02:04:59.648864+0000","last_clean":"2024-09-11T02:04:59.648864+0000","last_became_active":"2024-09-11T01:58:27.047814+0000","last_became_peered":"2024-09-11T01:58:27.047814+0000","last_unstale":"2024-09-11T02:04:59.648864+0000","last_undegraded":"2024-09-11T02:04:59.648864+0000","last_fullsized":"2024-09-11T02:04:59.648864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:15.861207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040037900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":600,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.650909+0000","last_change":"2024-09-11T01:58:28.994589+0000","last_active":"2024-09-11T02:05:00.650909+0000","last_peered":"2024-09-11T02:05:00.650909+0000","last_clean":"2024-09-11T02:05:00.650909+0000","last_became_active":"2024-09-11T01:58:26.989307+0000","last_became_peered":"2024-09-11T01:58:26.989307+0000","last_unstale":"2024-09-11T02:05:00.650909+0000","last_undegraded":"2024-09-11T02:05:00.650909+0000","last_fullsized":"2024-09-11T02:05:00.650909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:05.162449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001059894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":605,"reported_epoch":315,"state":"active+clean","last_fresh":"2024-09-11T02:04:59.650574+0000","last_change":"2024-09-11T01:58:28.988266+0000","last_active":"2024-09-11T02:04:59.650574+0000","last_peered":"2024-09-11T02:04:59.650574+0000","last_clean":"2024-09-11T02:04:59.650574+0000","last_became_active":"2024-09-11T01:58:26.991911+0000","last_became_peered":"2024-09-11T01:58:26.991911+0000","last_unstale":"2024-09-11T02:04:59.650574+0000","last_undegraded":"2024-09-11T02:04:59.650574+0000","last_fullsized":"2024-09-11T02:04:59.650574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:11.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051120699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":600,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.649680+0000","last_change":"2024-09-11T01:58:28.994578+0000","last_active":"2024-09-11T02:05:00.649680+0000","last_peered":"2024-09-11T02:05:00.649680+0000","last_clean":"2024-09-11T02:05:00.649680+0000","last_became_active":"2024-09-11T01:58:26.989353+0000","last_became_peered":"2024-09-11T01:58:26.989353+0000","last_unstale":"2024-09-11T02:05:00.649680+0000","last_undegraded":"2024-09-11T02:05:00.649680+0000","last_fullsized":"2024-09-11T02:05:00.649680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:37.795438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010300419999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":607,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.649566+0000","last_change":"2024-09-11T01:58:28.992277+0000","last_active":"2024-09-11T02:05:00.649566+0000","last_peered":"2024-09-11T02:05:00.649566+0000","last_clean":"2024-09-11T02:05:00.649566+0000","last_became_active":"2024-09-11T01:58:26.992547+0000","last_became_peered":"2024-09-11T01:58:26.992547+0000","last_unstale":"2024-09-11T02:05:00.649566+0000","last_undegraded":"2024-09-11T02:05:00.649566+0000","last_fullsized":"2024-09-11T02:05:00.649566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:48.184504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707749999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":610,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.695741+0000","last_change":"2024-09-11T01:58:28.988691+0000","last_active":"2024-09-11T02:05:00.695741+0000","last_peered":"2024-09-11T02:05:00.695741+0000","last_clean":"2024-09-11T02:05:00.695741+0000","last_became_active":"2024-09-11T01:58:26.989539+0000","last_became_peered":"2024-09-11T01:58:26.989539+0000","last_unstale":"2024-09-11T02:05:00.695741+0000","last_undegraded":"2024-09-11T02:05:00.695741+0000","last_fullsized":"2024-09-11T02:05:00.695741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:05.294029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063444800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":605,"reported_epoch":315,"state":"active+clean","last_fresh":"2024-09-11T02:04:59.650516+0000","last_change":"2024-09-11T01:58:28.988518+0000","last_active":"2024-09-11T02:04:59.650516+0000","last_peered":"2024-09-11T02:04:59.650516+0000","last_clean":"2024-09-11T02:04:59.650516+0000","last_became_active":"2024-09-11T01:58:26.992110+0000","last_became_peered":"2024-09-11T01:58:26.992110+0000","last_unstale":"2024-09-11T02:04:59.650516+0000","last_undegraded":"2024-09-11T02:04:59.650516+0000","last_fullsized":"2024-09-11T02:04:59.650516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:47.916474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058377799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":606,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.650254+0000","last_change":"2024-09-11T01:58:28.991608+0000","last_active":"2024-09-11T02:05:00.650254+0000","last_peered":"2024-09-11T02:05:00.650254+0000","last_clean":"2024-09-11T02:05:00.650254+0000","last_became_active":"2024-09-11T01:58:26.992862+0000","last_became_peered":"2024-09-11T01:58:26.992862+0000","last_unstale":"2024-09-11T02:05:00.650254+0000","last_undegraded":"2024-09-11T02:05:00.650254+0000","last_fullsized":"2024-09-11T02:05:00.650254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:02.837285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038950200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":696,"reported_epoch":315,"state":"active+clean","last_fresh":"2024-09-11T02:04:59.650684+0000","last_change":"2024-09-11T01:58:22.348806+0000","last_active":"2024-09-11T02:04:59.650684+0000","last_peered":"2024-09-11T02:04:59.650684+0000","last_clean":"2024-09-11T02:04:59.650684+0000","last_became_active":"2024-09-11T01:58:22.347800+0000","last_became_peered":"2024-09-11T01:58:22.347800+0000","last_unstale":"2024-09-11T02:04:59.650684+0000","last_undegraded":"2024-09-11T02:04:59.650684+0000","last_fullsized":"2024-09-11T02:04:59.650684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_clean_scrub_stamp":"2024-09-11T01:58:20.928503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:37.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1224704,"data_stored":446521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1220608,"data_stored":446502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1253376,"data_stored":444050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1302528,"data_stored":972882,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607635,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1253376,"data_stored":967178,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640339,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44860,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326980,"statfs":{"total":96636764160,"available":96590827520,"internally_reserved":0,"allocated":1224704,"data_stored":446521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T02:05:04.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T02:05:04.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.744+0000 7f7260a9b640 10 monclient: get_monmap_and_config 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.744+0000 7f7260a9b640 10 monclient: build_initial_monmap 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.744+0000 7f7260a9b640 10 monclient: monmap: 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:04.745286+0000 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:04.745286+0000 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:04.747 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 1 Processor -- start 2024-09-11T02:05:04.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 1 -- start start 2024-09-11T02:05:04.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 10 monclient: init 2024-09-11T02:05:04.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:04.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 10 monclient: _add_conns ranks=[2,6,4,1,3,8,5,0,7] 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 10 monclient(hunting): picked mon.noname-b con 0x7f725c0a5ba0 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 10 monclient(hunting): picked mon.noname-d con 0x7f725c09db00 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 10 monclient(hunting): picked mon.noname-c con 0x7f725c0a6690 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725c0a7a50 con 0x7f725c0a5ba0 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725c06fb30 con 0x7f725c0a6690 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725c09ce40 con 0x7f725c09db00 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7260a9b640 10 monclient(hunting): authenticate will time out at 1146.349719s 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7253fff640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f725c09db00 0x7f725c13ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50348/0 (socket says 172.21.15.73:50348) 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.745+0000 7f7253fff640 1 -- 172.21.15.73:0/1677918041 learned_addr learned my addr 172.21.15.73:0/1677918041 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847257624 0 0) 0x7f725c09ce40 con 0x7f725c09db00 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): my global_id is 115710 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7248003520 con 0x7f725c09db00 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887723143 0 0) 0x7f725c0a7a50 con 0x7f725c0a5ba0 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): my global_id is 134930 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725c09ce40 con 0x7f725c0a5ba0 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2873669158 0 0) 0x7f725c06fb30 con 0x7f725c0a6690 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient(hunting): my global_id is 6457 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725c0a7a50 con 0x7f725c0a6690 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1092815174 0 0) 0x7f725c09ce40 con 0x7f725c0a5ba0 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 >> v1:172.21.15.73:6792/0 conn(0x7f725c09db00 legacy=0x7f725c13ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 >> v1:172.21.15.73:6791/0 conn(0x7f725c0a6690 legacy=0x7f725c1414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: _finish_hunting 0 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 monclient: found mon.noname-b 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725c0a7440 con 0x7f725c0a5ba0 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: _finish_auth 0 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: _check_auth_tickets 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7260a9b640 5 monclient: authenticate success, global_id 134930 2024-09-11T02:05:04.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f724c0016c0 con 0x7f725c0a5ba0 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: dump: 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.758 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7260a9b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f724c001860 con 0x7f725c0a5ba0 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 1 -- 172.21.15.73:0/1677918041 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f724c003610 con 0x7f725c0a5ba0 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7260a9b640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7260a9b640 4 set_mon_vals no callback set 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:04.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7259d9b640 10 monclient: dump: 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.760 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7260a9b640 10 monclient: shutdown 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7260a9b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7260a9b640 1 -- 172.21.15.73:0/1677918041 >> v1:172.21.15.73:6790/0 conn(0x7f725c0a5ba0 legacy=0x7f725c0a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7260a9b640 1 -- 172.21.15.73:0/1677918041 shutdown_connections 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.746+0000 7f7260a9b640 1 -- 172.21.15.73:0/1677918041 >> 172.21.15.73:0/1677918041 conn(0x7f725c0a7e80 msgr2=0x7f725c0a8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.747+0000 7f7260a9b640 1 -- 172.21.15.73:0/1677918041 shutdown_connections 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.747+0000 7f7260a9b640 1 -- 172.21.15.73:0/1677918041 wait complete. 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.747+0000 7f7260a9b640 10 monclient: build_initial_monmap 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.747+0000 7f7260a9b640 10 monclient: monmap: 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:04.761 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.747+0000 7f7260a9b640 1 Processor -- start 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 1 -- start start 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 10 monclient: init 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 10 monclient: _add_conns ranks=[5,0,6,3,4,1,7,8,2] 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 10 monclient(hunting): picked mon.noname-h con 0x7f725c09db00 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 10 monclient(hunting): picked mon.noname-a con 0x7f725c0a5ba0 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 10 monclient(hunting): picked mon.noname-d con 0x7f725c0a6690 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725c1261c0 con 0x7f725c0a5ba0 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725c128840 con 0x7f725c09db00 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725c128b20 con 0x7f725c0a6690 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7260a9b640 10 monclient(hunting): authenticate will time out at 1146.352511s 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f725ad9d640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f725c0a6690 0x7f725c1d5850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50364/0 (socket says 172.21.15.73:50364) 2024-09-11T02:05:04.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f725ad9d640 1 -- 172.21.15.73:0/1449563134 learned_addr learned my addr 172.21.15.73:0/1449563134 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324957450 0 0) 0x7f725c128b20 con 0x7f725c0a6690 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 10 monclient(hunting): my global_id is 115719 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f723c003520 con 0x7f725c0a6690 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2155425319 0 0) 0x7f7244001270 con 0x7f725c0a5ba0 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 10 monclient(hunting): my global_id is 6723 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725c128b20 con 0x7f725c0a5ba0 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3394773605 0 0) 0x7f723c003520 con 0x7f725c0a6690 2024-09-11T02:05:04.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7244001270 con 0x7f725c0a6690 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.748+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f72540016d0 con 0x7f725c0a6690 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.765 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3311679649 0 0) 0x7f725c128b20 con 0x7f725c0a5ba0 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f723c003520 con 0x7f725c0a5ba0 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7244001ce0 con 0x7f725c0a5ba0 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:04.766 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492471659 0 0) 0x7f725c128840 con 0x7f725c09db00 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient(hunting): my global_id is 144221 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725c128b20 con 0x7f725c09db00 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 313248333 0 0) 0x7f7244001270 con 0x7f725c0a6690 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 >> v1:172.21.15.203:6791/0 conn(0x7f725c09db00 legacy=0x7f725c125ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 >> v1:172.21.15.73:6789/0 conn(0x7f725c0a5ba0 legacy=0x7f725c1d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 monclient: found mon.d 2024-09-11T02:05:04.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725c127cb0 con 0x7f725c0a6690 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient: _finish_auth 0 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7260a9b640 5 monclient: authenticate success, global_id 115719 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7260a9b640 10 monclient: _renew_subs 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7260a9b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f725c1267c0 con 0x7f725c0a6690 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7260a9b640 10 monclient: _renew_subs 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7260a9b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f725c125250 con 0x7f725c0a6690 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7254003c20 con 0x7f725c0a6690 2024-09-11T02:05:04.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f72540041d0 con 0x7f725c0a6690 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f725959a640 4 set_mon_vals no callback set 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.749+0000 7f7252ffd640 10 monclient: dump: 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:04.770 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.750+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f7254004370 con 0x7f725c0a6690 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.750+0000 7f7260a9b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.750+0000 7f7260a9b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.750+0000 7f7260a9b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.750+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7240005080 con 0x7f725c0a6690 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.750+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f725404e620 con 0x7f725c0a6690 2024-09-11T02:05:04.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.750+0000 7f725a59c640 10 monclient: get_auth_request con 0x7f723c040390 auth_method 0 2024-09-11T02:05:04.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.754+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f7254017960 con 0x7f725c0a6690 2024-09-11T02:05:04.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.754+0000 7f7252ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:04.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.754+0000 7f7252ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:04.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.928+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7240000b90 con 0x7f723c040390 2024-09-11T02:05:04.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.929+0000 7f7252ffd640 1 -- 172.21.15.73:0/1449563134 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34090 (unknown 2965378022 0 2111474679) 0x7f7240000b90 con 0x7f723c040390 2024-09-11T02:05:04.931 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T02:05:04.932 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-11T02:05:04.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.932+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 >> v1:172.21.15.203:6812/2311533528 conn(0x7f723c040390 legacy=0x7f723c042850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.932+0000 7f7260a9b640 10 monclient: shutdown 2024-09-11T02:05:04.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.932+0000 7f7260a9b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:04.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.932+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 >> v1:172.21.15.73:6792/0 conn(0x7f725c0a6690 legacy=0x7f725c1d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:04.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.932+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 shutdown_connections 2024-09-11T02:05:04.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.932+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 >> 172.21.15.73:0/1449563134 conn(0x7f725c0a7e80 msgr2=0x7f725c0a4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:04.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.932+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 shutdown_connections 2024-09-11T02:05:04.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:04.932+0000 7f7260a9b640 1 -- 172.21.15.73:0/1449563134 wait complete. 2024-09-11T02:05:04.944 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":515,"stamp":"2024-09-11T02:05:02.962122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":190292,"kb_used_data":7304,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566040748,"statfs":{"total":579820584960,"available":579625725952,"internally_reserved":0,"allocated":7479296,"data_stored":3723654,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9567,"internal_metadata":187226785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.317138"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":605,"reported_epoch":315,"state":"active+clean","last_fresh":"2024-09-11T02:04:59.648864+0000","last_change":"2024-09-11T01:58:28.988312+0000","last_active":"2024-09-11T02:04:59.648864+0000","last_peered":"2024-09-11T02:04:59.648864+0000","last_clean":"2024-09-11T02:04:59.648864+0000","last_became_active":"2024-09-11T01:58:27.047814+0000","last_became_peered":"2024-09-11T01:58:27.047814+0000","last_unstale":"2024-09-11T02:04:59.648864+0000","last_undegraded":"2024-09-11T02:04:59.648864+0000","last_fullsized":"2024-09-11T02:04:59.648864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:15.861207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040037900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":600,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.650909+0000","last_change":"2024-09-11T01:58:28.994589+0000","last_active":"2024-09-11T02:05:00.650909+0000","last_peered":"2024-09-11T02:05:00.650909+0000","last_clean":"2024-09-11T02:05:00.650909+0000","last_became_active":"2024-09-11T01:58:26.989307+0000","last_became_peered":"2024-09-11T01:58:26.989307+0000","last_unstale":"2024-09-11T02:05:00.650909+0000","last_undegraded":"2024-09-11T02:05:00.650909+0000","last_fullsized":"2024-09-11T02:05:00.650909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:05.162449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001059894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":605,"reported_epoch":315,"state":"active+clean","last_fresh":"2024-09-11T02:04:59.650574+0000","last_change":"2024-09-11T01:58:28.988266+0000","last_active":"2024-09-11T02:04:59.650574+0000","last_peered":"2024-09-11T02:04:59.650574+0000","last_clean":"2024-09-11T02:04:59.650574+0000","last_became_active":"2024-09-11T01:58:26.991911+0000","last_became_peered":"2024-09-11T01:58:26.991911+0000","last_unstale":"2024-09-11T02:04:59.650574+0000","last_undegraded":"2024-09-11T02:04:59.650574+0000","last_fullsized":"2024-09-11T02:04:59.650574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:11.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051120699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":600,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.649680+0000","last_change":"2024-09-11T01:58:28.994578+0000","last_active":"2024-09-11T02:05:00.649680+0000","last_peered":"2024-09-11T02:05:00.649680+0000","last_clean":"2024-09-11T02:05:00.649680+0000","last_became_active":"2024-09-11T01:58:26.989353+0000","last_became_peered":"2024-09-11T01:58:26.989353+0000","last_unstale":"2024-09-11T02:05:00.649680+0000","last_undegraded":"2024-09-11T02:05:00.649680+0000","last_fullsized":"2024-09-11T02:05:00.649680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:37.795438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010300419999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":607,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.649566+0000","last_change":"2024-09-11T01:58:28.992277+0000","last_active":"2024-09-11T02:05:00.649566+0000","last_peered":"2024-09-11T02:05:00.649566+0000","last_clean":"2024-09-11T02:05:00.649566+0000","last_became_active":"2024-09-11T01:58:26.992547+0000","last_became_peered":"2024-09-11T01:58:26.992547+0000","last_unstale":"2024-09-11T02:05:00.649566+0000","last_undegraded":"2024-09-11T02:05:00.649566+0000","last_fullsized":"2024-09-11T02:05:00.649566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:48.184504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707749999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":610,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.695741+0000","last_change":"2024-09-11T01:58:28.988691+0000","last_active":"2024-09-11T02:05:00.695741+0000","last_peered":"2024-09-11T02:05:00.695741+0000","last_clean":"2024-09-11T02:05:00.695741+0000","last_became_active":"2024-09-11T01:58:26.989539+0000","last_became_peered":"2024-09-11T01:58:26.989539+0000","last_unstale":"2024-09-11T02:05:00.695741+0000","last_undegraded":"2024-09-11T02:05:00.695741+0000","last_fullsized":"2024-09-11T02:05:00.695741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:05.294029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063444800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":605,"reported_epoch":315,"state":"active+clean","last_fresh":"2024-09-11T02:04:59.650516+0000","last_change":"2024-09-11T01:58:28.988518+0000","last_active":"2024-09-11T02:04:59.650516+0000","last_peered":"2024-09-11T02:04:59.650516+0000","last_clean":"2024-09-11T02:04:59.650516+0000","last_became_active":"2024-09-11T01:58:26.992110+0000","last_became_peered":"2024-09-11T01:58:26.992110+0000","last_unstale":"2024-09-11T02:04:59.650516+0000","last_undegraded":"2024-09-11T02:04:59.650516+0000","last_fullsized":"2024-09-11T02:04:59.650516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:47.916474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058377799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":606,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.650254+0000","last_change":"2024-09-11T01:58:28.991608+0000","last_active":"2024-09-11T02:05:00.650254+0000","last_peered":"2024-09-11T02:05:00.650254+0000","last_clean":"2024-09-11T02:05:00.650254+0000","last_became_active":"2024-09-11T01:58:26.992862+0000","last_became_peered":"2024-09-11T01:58:26.992862+0000","last_unstale":"2024-09-11T02:05:00.650254+0000","last_undegraded":"2024-09-11T02:05:00.650254+0000","last_fullsized":"2024-09-11T02:05:00.650254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:02.837285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038950200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":696,"reported_epoch":315,"state":"active+clean","last_fresh":"2024-09-11T02:04:59.650684+0000","last_change":"2024-09-11T01:58:22.348806+0000","last_active":"2024-09-11T02:04:59.650684+0000","last_peered":"2024-09-11T02:04:59.650684+0000","last_clean":"2024-09-11T02:04:59.650684+0000","last_became_active":"2024-09-11T01:58:22.347800+0000","last_became_peered":"2024-09-11T01:58:22.347800+0000","last_unstale":"2024-09-11T02:04:59.650684+0000","last_undegraded":"2024-09-11T02:04:59.650684+0000","last_fullsized":"2024-09-11T02:04:59.650684+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_clean_scrub_stamp":"2024-09-11T01:58:20.928503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:37.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1224704,"data_stored":446521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1220608,"data_stored":446502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1253376,"data_stored":444050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1302528,"data_stored":972882,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607635,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1253376,"data_stored":967178,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640339,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44860,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326980,"statfs":{"total":96636764160,"available":96590827520,"internally_reserved":0,"allocated":1224704,"data_stored":446521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T02:05:04.945 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T02:05:04.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T02:05:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.040+0000 7f6bd6d2b640 10 monclient: get_monmap_and_config 2024-09-11T02:05:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.040+0000 7f6bd6d2b640 10 monclient: build_initial_monmap 2024-09-11T02:05:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.040+0000 7f6bd6d2b640 10 monclient: monmap: 2024-09-11T02:05:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.042 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:05.041392+0000 2024-09-11T02:05:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:05.041392+0000 2024-09-11T02:05:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:05.043 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:05.044 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:05.044 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:05.044 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:05.044 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:05.044 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 1 Processor -- start 2024-09-11T02:05:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 1 -- start start 2024-09-11T02:05:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 10 monclient: init 2024-09-11T02:05:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:05.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 10 monclient: _add_conns ranks=[3,5,7,0,1,8,2,6,4] 2024-09-11T02:05:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 10 monclient(hunting): picked mon.noname-g con 0x7f6bd0138e40 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 10 monclient(hunting): picked mon.noname-h con 0x7f6bd0139220 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 10 monclient(hunting): picked mon.noname-i con 0x7f6bd013f250 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd009d190 con 0x7f6bd0138e40 2024-09-11T02:05:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd009e280 con 0x7f6bd0139220 2024-09-11T02:05:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd009ceb0 con 0x7f6bd013f250 2024-09-11T02:05:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:05.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.041+0000 7f6bd6d2b640 10 monclient(hunting): authenticate will time out at 1146.645811s 2024-09-11T02:05:05.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcffff640 1 --1- >> v1:172.21.15.203:6791/0 conn(0x7f6bd0139220 0x7f6bd013db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6791/0 says I am v1:172.21.15.73:45374/0 (socket says 172.21.15.73:45374) 2024-09-11T02:05:05.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bd4ac7640 1 --1- >> v1:172.21.15.203:6790/0 conn(0x7f6bd0138e40 0x7f6bd009db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6790/0 says I am v1:172.21.15.73:39444/0 (socket says 172.21.15.73:39444) 2024-09-11T02:05:05.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bd52c8640 1 --1- >> v1:172.21.15.203:6792/0 conn(0x7f6bd013f250 0x7f6bd0141640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6792/0 says I am v1:172.21.15.73:36308/0 (socket says 172.21.15.73:36308) 2024-09-11T02:05:05.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcffff640 1 -- 172.21.15.73:0/4162734372 learned_addr learned my addr 172.21.15.73:0/4162734372 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:05.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616508587 0 0) 0x7f6bd009ceb0 con 0x7f6bd013f250 2024-09-11T02:05:05.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): my global_id is 6577 2024-09-11T02:05:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bc0003520 con 0x7f6bd013f250 2024-09-11T02:05:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 323042957 0 0) 0x7f6bc4001110 con 0x7f6bd0138e40 2024-09-11T02:05:05.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): my global_id is 6582 2024-09-11T02:05:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bd009ceb0 con 0x7f6bd0138e40 2024-09-11T02:05:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 200243661 0 0) 0x7f6bd009e280 con 0x7f6bd0139220 2024-09-11T02:05:05.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient(hunting): my global_id is 144230 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bc4001110 con 0x7f6bd0139220 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3654160962 0 0) 0x7f6bc0003520 con 0x7f6bd013f250 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 >> v1:172.21.15.203:6791/0 conn(0x7f6bd0139220 legacy=0x7f6bd013db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 >> v1:172.21.15.203:6790/0 conn(0x7f6bd0138e40 legacy=0x7f6bd009db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 monclient: found mon.noname-i 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.203:6792/0 2024-09-11T02:05:05.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 --> v1:172.21.15.203:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd009d470 con 0x7f6bd013f250 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6bc8001bb0 con 0x7f6bd013f250 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bd6d2b640 5 monclient: authenticate success, global_id 6577 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bd6d2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bcf7fe640 10 monclient: dump: 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.060 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.062 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.062 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.062 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.062 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.062 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.042+0000 7f6bd6d2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:05.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 <== mon.7 v1:172.21.15.203:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bc8001d50 con 0x7f6bd013f250 2024-09-11T02:05:05.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bcf7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bcf7fe640 1 -- 172.21.15.73:0/4162734372 <== mon.7 v1:172.21.15.203:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6bc8004ea0 con 0x7f6bd013f250 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bd6d2b640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bd6d2b640 4 set_mon_vals no callback set 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bcf7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bcf7fe640 10 monclient: dump: 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.063 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bd6d2b640 10 monclient: shutdown 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bd6d2b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:05.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/4162734372 >> v1:172.21.15.203:6792/0 conn(0x7f6bd013f250 legacy=0x7f6bd0141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/4162734372 shutdown_connections 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/4162734372 >> 172.21.15.73:0/4162734372 conn(0x7f6bd00abe10 msgr2=0x7f6bd00a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/4162734372 shutdown_connections 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.043+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/4162734372 wait complete. 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.044+0000 7f6bd6d2b640 10 monclient: build_initial_monmap 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.044+0000 7f6bd6d2b640 10 monclient: monmap: 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:05.065 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.044+0000 7f6bd6d2b640 1 Processor -- start 2024-09-11T02:05:05.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.044+0000 7f6bd6d2b640 1 -- start start 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.044+0000 7f6bd6d2b640 10 monclient: init 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.044+0000 7f6bd6d2b640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.044+0000 7f6bd6d2b640 10 monclient: _add_conns ranks=[0,1,2,8,4,7,3,6,5] 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.044+0000 7f6bd6d2b640 10 monclient(hunting): picked mon.noname-a con 0x7f6bd0138e40 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.044+0000 7f6bd6d2b640 10 monclient(hunting): picked mon.noname-f con 0x7f6bd0139220 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 10 monclient(hunting): picked mon.noname-b con 0x7f6bd013f250 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd013ab00 con 0x7f6bd0138e40 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd013ade0 con 0x7f6bd0139220 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd00a5430 con 0x7f6bd013f250 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 10 monclient(hunting): authenticate will time out at 1146.649032s 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd52c8640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f6bd013f250 0x7f6bd01d5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41862/0 (socket says 172.21.15.73:41862) 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd4ac7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6bd0138e40 0x7f6bd00a3100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60394/0 (socket says 172.21.15.73:60394) 2024-09-11T02:05:05.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd52c8640 1 -- 172.21.15.73:0/2267186024 learned_addr learned my addr 172.21.15.73:0/2267186024 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1050581294 0 0) 0x7f6bd00a5430 con 0x7f6bd013f250 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): my global_id is 134939 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bb4003520 con 0x7f6bd013f250 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752447783 0 0) 0x7f6bd013ab00 con 0x7f6bd0138e40 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): my global_id is 6732 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bd00a5430 con 0x7f6bd0138e40 2024-09-11T02:05:05.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056380180 0 0) 0x7f6bd013ade0 con 0x7f6bd0139220 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): my global_id is 144199 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bd013ab00 con 0x7f6bd0139220 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1483528270 0 0) 0x7f6bb4003520 con 0x7f6bd013f250 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bd013ade0 con 0x7f6bd013f250 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6bc8001b30 con 0x7f6bd013f250 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): dump: 2024-09-11T02:05:05.069 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.070 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.070 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.070 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.070 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3663419520 0 0) 0x7f6bd00a5430 con 0x7f6bd0138e40 2024-09-11T02:05:05.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bb4003520 con 0x7f6bd0138e40 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6bc4001d40 con 0x7f6bd0138e40 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient(hunting): dump: 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2630897633 0 0) 0x7f6bd013ab00 con 0x7f6bd0139220 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.203:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bd00a5430 con 0x7f6bd0139220 2024-09-11T02:05:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2776656996 0 0) 0x7f6bd013ade0 con 0x7f6bd013f250 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 >> v1:172.21.15.203:6789/0 conn(0x7f6bd0139220 legacy=0x7f6bd00a3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 >> v1:172.21.15.73:6789/0 conn(0x7f6bd0138e40 legacy=0x7f6bd00a3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient: _finish_hunting 0 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 monclient: found mon.b 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd0139900 con 0x7f6bd013f250 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient: _finish_auth 0 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 10 monclient: _check_auth_tickets 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bcd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 5 monclient: authenticate success, global_id 134939 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 10 monclient: _renew_subs 2024-09-11T02:05:05.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd00a48d0 con 0x7f6bd013f250 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 10 monclient: _renew_subs 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.045+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6bd00a3f20 con 0x7f6bd013f250 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bc8001d50 con 0x7f6bd013f250 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bcd7fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6bc8005150 con 0x7f6bd013f250 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bcd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bceffd640 4 set_mon_vals no callback set 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bcd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bcd7fa640 10 monclient: dump: 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.075 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.076 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f6bc8005370 con 0x7f6bd013f250 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bd6d2b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bd6d2b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bd6d2b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.046+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb0005080 con 0x7f6bd013f250 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.047+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f6bc804e4a0 con 0x7f6bd013f250 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.047+0000 7f6bd4ac7640 10 monclient: get_auth_request con 0x7f6bb4040460 auth_method 0 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.051+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f6bc8017920 con 0x7f6bd013f250 2024-09-11T02:05:05.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.051+0000 7f6bcd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:05.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.051+0000 7f6bcd7fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:05.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.221+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6bb0000b90 con 0x7f6bb4040460 2024-09-11T02:05:05.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.222+0000 7f6bcd7fa640 1 -- 172.21.15.73:0/2267186024 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34073 (unknown 2965378022 0 1860099888) 0x7f6bb0000b90 con 0x7f6bb4040460 2024-09-11T02:05:05.224 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T02:05:05.225 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-11T02:05:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.224+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 >> v1:172.21.15.203:6812/2311533528 conn(0x7f6bb4040460 legacy=0x7f6bb4042920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.224+0000 7f6bd6d2b640 10 monclient: shutdown 2024-09-11T02:05:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.224+0000 7f6bd6d2b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:05.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.224+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 >> v1:172.21.15.73:6790/0 conn(0x7f6bd013f250 legacy=0x7f6bd01d5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.225+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 shutdown_connections 2024-09-11T02:05:05.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.225+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 >> 172.21.15.73:0/2267186024 conn(0x7f6bd00abe10 msgr2=0x7f6bd0137560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:05.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.225+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 shutdown_connections 2024-09-11T02:05:05.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.225+0000 7f6bd6d2b640 1 -- 172.21.15.73:0/2267186024 wait complete. 2024-09-11T02:05:05.236 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":516,"stamp":"2024-09-11T02:05:04.962365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":190320,"kb_used_data":7332,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566040720,"statfs":{"total":579820584960,"available":579625697280,"internally_reserved":0,"allocated":7507968,"data_stored":3735612,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9567,"internal_metadata":187226785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001243"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":609,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625592+0000","last_change":"2024-09-11T01:58:28.988312+0000","last_active":"2024-09-11T02:05:02.625592+0000","last_peered":"2024-09-11T02:05:02.625592+0000","last_clean":"2024-09-11T02:05:02.625592+0000","last_became_active":"2024-09-11T01:58:27.047814+0000","last_became_peered":"2024-09-11T01:58:27.047814+0000","last_unstale":"2024-09-11T02:05:02.625592+0000","last_undegraded":"2024-09-11T02:05:02.625592+0000","last_fullsized":"2024-09-11T02:05:02.625592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:15.861207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040037900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":600,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.650909+0000","last_change":"2024-09-11T01:58:28.994589+0000","last_active":"2024-09-11T02:05:00.650909+0000","last_peered":"2024-09-11T02:05:00.650909+0000","last_clean":"2024-09-11T02:05:00.650909+0000","last_became_active":"2024-09-11T01:58:26.989307+0000","last_became_peered":"2024-09-11T01:58:26.989307+0000","last_unstale":"2024-09-11T02:05:00.650909+0000","last_undegraded":"2024-09-11T02:05:00.650909+0000","last_fullsized":"2024-09-11T02:05:00.650909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:05.162449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001059894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":609,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625690+0000","last_change":"2024-09-11T01:58:28.988266+0000","last_active":"2024-09-11T02:05:02.625690+0000","last_peered":"2024-09-11T02:05:02.625690+0000","last_clean":"2024-09-11T02:05:02.625690+0000","last_became_active":"2024-09-11T01:58:26.991911+0000","last_became_peered":"2024-09-11T01:58:26.991911+0000","last_unstale":"2024-09-11T02:05:02.625690+0000","last_undegraded":"2024-09-11T02:05:02.625690+0000","last_fullsized":"2024-09-11T02:05:02.625690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:11.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051120699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":600,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.649680+0000","last_change":"2024-09-11T01:58:28.994578+0000","last_active":"2024-09-11T02:05:00.649680+0000","last_peered":"2024-09-11T02:05:00.649680+0000","last_clean":"2024-09-11T02:05:00.649680+0000","last_became_active":"2024-09-11T01:58:26.989353+0000","last_became_peered":"2024-09-11T01:58:26.989353+0000","last_unstale":"2024-09-11T02:05:00.649680+0000","last_undegraded":"2024-09-11T02:05:00.649680+0000","last_fullsized":"2024-09-11T02:05:00.649680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:37.795438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010300419999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":607,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.649566+0000","last_change":"2024-09-11T01:58:28.992277+0000","last_active":"2024-09-11T02:05:00.649566+0000","last_peered":"2024-09-11T02:05:00.649566+0000","last_clean":"2024-09-11T02:05:00.649566+0000","last_became_active":"2024-09-11T01:58:26.992547+0000","last_became_peered":"2024-09-11T01:58:26.992547+0000","last_unstale":"2024-09-11T02:05:00.649566+0000","last_undegraded":"2024-09-11T02:05:00.649566+0000","last_fullsized":"2024-09-11T02:05:00.649566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:48.184504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707749999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":610,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.695741+0000","last_change":"2024-09-11T01:58:28.988691+0000","last_active":"2024-09-11T02:05:00.695741+0000","last_peered":"2024-09-11T02:05:00.695741+0000","last_clean":"2024-09-11T02:05:00.695741+0000","last_became_active":"2024-09-11T01:58:26.989539+0000","last_became_peered":"2024-09-11T01:58:26.989539+0000","last_unstale":"2024-09-11T02:05:00.695741+0000","last_undegraded":"2024-09-11T02:05:00.695741+0000","last_fullsized":"2024-09-11T02:05:00.695741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:05.294029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063444800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":609,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625573+0000","last_change":"2024-09-11T01:58:28.988518+0000","last_active":"2024-09-11T02:05:02.625573+0000","last_peered":"2024-09-11T02:05:02.625573+0000","last_clean":"2024-09-11T02:05:02.625573+0000","last_became_active":"2024-09-11T01:58:26.992110+0000","last_became_peered":"2024-09-11T01:58:26.992110+0000","last_unstale":"2024-09-11T02:05:02.625573+0000","last_undegraded":"2024-09-11T02:05:02.625573+0000","last_fullsized":"2024-09-11T02:05:02.625573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:47.916474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058377799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":606,"reported_epoch":316,"state":"active+clean","last_fresh":"2024-09-11T02:05:00.650254+0000","last_change":"2024-09-11T01:58:28.991608+0000","last_active":"2024-09-11T02:05:00.650254+0000","last_peered":"2024-09-11T02:05:00.650254+0000","last_clean":"2024-09-11T02:05:00.650254+0000","last_became_active":"2024-09-11T01:58:26.992862+0000","last_became_peered":"2024-09-11T01:58:26.992862+0000","last_unstale":"2024-09-11T02:05:00.650254+0000","last_undegraded":"2024-09-11T02:05:00.650254+0000","last_fullsized":"2024-09-11T02:05:00.650254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:02.837285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038950200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":700,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625688+0000","last_change":"2024-09-11T01:58:22.348806+0000","last_active":"2024-09-11T02:05:02.625688+0000","last_peered":"2024-09-11T02:05:02.625688+0000","last_clean":"2024-09-11T02:05:02.625688+0000","last_became_active":"2024-09-11T01:58:22.347800+0000","last_became_peered":"2024-09-11T01:58:22.347800+0000","last_unstale":"2024-09-11T02:05:02.625688+0000","last_undegraded":"2024-09-11T02:05:02.625688+0000","last_fullsized":"2024-09-11T02:05:02.625688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_clean_scrub_stamp":"2024-09-11T01:58:20.928503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:37.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1224704,"data_stored":446521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1220608,"data_stored":446502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":1253376,"data_stored":444050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574931,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1302528,"data_stored":972882,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607636,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1282048,"data_stored":979136,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640339,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44860,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326980,"statfs":{"total":96636764160,"available":96590827520,"internally_reserved":0,"allocated":1224704,"data_stored":446521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T02:05:05.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T02:05:05.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.332+0000 7f4c7b33d640 10 monclient: get_monmap_and_config 2024-09-11T02:05:05.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.332+0000 7f4c7b33d640 10 monclient: build_initial_monmap 2024-09-11T02:05:05.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.332+0000 7f4c7b33d640 10 monclient: monmap: 2024-09-11T02:05:05.335 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:05.335 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.335 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:05.333452+0000 2024-09-11T02:05:05.336 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:05.333452+0000 2024-09-11T02:05:05.336 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:05.336 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.336 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:05.336 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:05.336 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:05.337 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:05.337 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:05.337 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:05.337 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:05.337 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:05.337 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:05.338 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 1 Processor -- start 2024-09-11T02:05:05.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 1 -- start start 2024-09-11T02:05:05.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 10 monclient: init 2024-09-11T02:05:05.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:05.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 10 monclient: _add_conns ranks=[2,7,6,5,0,1,4,3,8] 2024-09-11T02:05:05.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 10 monclient(hunting): picked mon.noname-b con 0x7f4c74138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:05.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 10 monclient(hunting): picked mon.noname-i con 0x7f4c740a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:05.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 10 monclient(hunting): picked mon.noname-d con 0x7f4c7413f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:05.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7409ca00 con 0x7f4c74138d40 2024-09-11T02:05:05.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c740a7070 con 0x7f4c7413f350 2024-09-11T02:05:05.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7409cee0 con 0x7f4c740a72f0 2024-09-11T02:05:05.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:05.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c7b33d640 10 monclient(hunting): authenticate will time out at 1146.937870s 2024-09-11T02:05:05.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c790d9640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f4c74138d40 0x7f4c74139120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41864/0 (socket says 172.21.15.73:41864) 2024-09-11T02:05:05.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c798da640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f4c7413f350 0x7f4c74141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50380/0 (socket says 172.21.15.73:50380) 2024-09-11T02:05:05.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.333+0000 7f4c790d9640 1 -- 172.21.15.73:0/1801214641 learned_addr learned my addr 172.21.15.73:0/1801214641 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:05.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 326237548 0 0) 0x7f4c740a7070 con 0x7f4c7413f350 2024-09-11T02:05:05.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient(hunting): my global_id is 115728 2024-09-11T02:05:05.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c60003520 con 0x7f4c7413f350 2024-09-11T02:05:05.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510609047 0 0) 0x7f4c7409ca00 con 0x7f4c74138d40 2024-09-11T02:05:05.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient(hunting): my global_id is 134948 2024-09-11T02:05:05.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c740a7070 con 0x7f4c74138d40 2024-09-11T02:05:05.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1783315137 0 0) 0x7f4c60003520 con 0x7f4c7413f350 2024-09-11T02:05:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 >> v1:172.21.15.203:6792/0 conn(0x7f4c740a72f0 legacy=0x7f4c7413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 >> v1:172.21.15.73:6790/0 conn(0x7f4c74138d40 legacy=0x7f4c74139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: _finish_hunting 0 2024-09-11T02:05:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 monclient: found mon.noname-d 2024-09-11T02:05:05.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:05.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:05:05.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7409d1c0 con 0x7f4c7413f350 2024-09-11T02:05:05.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: _finish_auth 0 2024-09-11T02:05:05.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: _check_auth_tickets 2024-09-11T02:05:05.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:05.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4c6c001bb0 con 0x7f4c7413f350 2024-09-11T02:05:05.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c7b33d640 5 monclient: authenticate success, global_id 115728 2024-09-11T02:05:05.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c7b33d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:05.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:05.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:05.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: dump: 2024-09-11T02:05:05.358 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.359 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.359 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.359 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.359 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.359 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.359 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.360 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.360 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.360 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.360 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.360 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.360 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.361 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.361 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.361 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c7b33d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:05.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c6c001dd0 con 0x7f4c7413f350 2024-09-11T02:05:05.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:05.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 1 -- 172.21.15.73:0/1801214641 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4c6c004ea0 con 0x7f4c7413f350 2024-09-11T02:05:05.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c7b33d640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:05.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c7b33d640 4 set_mon_vals no callback set 2024-09-11T02:05:05.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:05.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:05.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.334+0000 7f4c6bfff640 10 monclient: dump: 2024-09-11T02:05:05.363 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.363 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.363 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.363 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.363 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.364 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.364 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.364 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.364 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.364 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.364 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.365 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.365 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.365 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.365 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.365 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.335+0000 7f4c7b33d640 10 monclient: shutdown 2024-09-11T02:05:05.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.335+0000 7f4c7b33d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:05.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.335+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1801214641 >> v1:172.21.15.73:6792/0 conn(0x7f4c7413f350 legacy=0x7f4c74141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.335+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1801214641 shutdown_connections 2024-09-11T02:05:05.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.335+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1801214641 >> 172.21.15.73:0/1801214641 conn(0x7f4c740a8050 msgr2=0x7f4c740a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:05.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.335+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1801214641 shutdown_connections 2024-09-11T02:05:05.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.335+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1801214641 wait complete. 2024-09-11T02:05:05.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.335+0000 7f4c7b33d640 10 monclient: build_initial_monmap 2024-09-11T02:05:05.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.335+0000 7f4c7b33d640 10 monclient: monmap: 2024-09-11T02:05:05.367 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:05.367 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:05.367 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:05.367 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:05.368 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:05.369 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 1 Processor -- start 2024-09-11T02:05:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 1 -- start start 2024-09-11T02:05:05.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 10 monclient: init 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 10 monclient: _add_conns ranks=[6,2,3,4,5,7,8,1,0] 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 10 monclient(hunting): picked mon.noname-d con 0x7f4c740a72f0 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 10 monclient(hunting): picked mon.noname-b con 0x7f4c74138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 10 monclient(hunting): picked mon.noname-g con 0x7f4c7413f350 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7413b8b0 con 0x7f4c74138d40 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c74139a90 con 0x7f4c7413f350 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7413ea30 con 0x7f4c740a72f0 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:05.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c7b33d640 10 monclient(hunting): authenticate will time out at 1146.940656s 2024-09-11T02:05:05.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c790d9640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f4c740a72f0 0x7f4c740a0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50388/0 (socket says 172.21.15.73:50388) 2024-09-11T02:05:05.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c790d9640 1 -- 172.21.15.73:0/1334841849 learned_addr learned my addr 172.21.15.73:0/1334841849 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:05.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c788d8640 1 --1- 172.21.15.73:0/1334841849 >> v1:172.21.15.73:6790/0 conn(0x7f4c74138d40 0x7f4c740a0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41866/0 (socket says 172.21.15.73:41866) 2024-09-11T02:05:05.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971509102 0 0) 0x7f4c7413ea30 con 0x7f4c740a72f0 2024-09-11T02:05:05.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 10 monclient(hunting): my global_id is 115737 2024-09-11T02:05:05.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c58003520 con 0x7f4c740a72f0 2024-09-11T02:05:05.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426160652 0 0) 0x7f4c7413b8b0 con 0x7f4c74138d40 2024-09-11T02:05:05.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 10 monclient(hunting): my global_id is 134957 2024-09-11T02:05:05.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.336+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c7413ea30 con 0x7f4c74138d40 2024-09-11T02:05:05.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814884720 0 0) 0x7f4c74139a90 con 0x7f4c7413f350 2024-09-11T02:05:05.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:05.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:05.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:05.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): my global_id is 6591 2024-09-11T02:05:05.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c7413b8b0 con 0x7f4c7413f350 2024-09-11T02:05:05.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3674231138 0 0) 0x7f4c58003520 con 0x7f4c740a72f0 2024-09-11T02:05:05.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c74139a90 con 0x7f4c740a72f0 2024-09-11T02:05:05.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4c70001570 con 0x7f4c740a72f0 2024-09-11T02:05:05.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:05.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:05.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): dump: 2024-09-11T02:05:05.374 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.374 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.374 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.374 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.374 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.374 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.374 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.374 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.374 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2342569467 0 0) 0x7f4c7413ea30 con 0x7f4c74138d40 2024-09-11T02:05:05.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c58003520 con 0x7f4c74138d40 2024-09-11T02:05:05.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4c64001a50 con 0x7f4c74138d40 2024-09-11T02:05:05.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:05.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:05.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient(hunting): dump: 2024-09-11T02:05:05.376 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.376 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.376 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.376 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.376 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.377 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.378 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 609245920 0 0) 0x7f4c74139a90 con 0x7f4c740a72f0 2024-09-11T02:05:05.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 >> v1:172.21.15.203:6790/0 conn(0x7f4c7413f350 legacy=0x7f4c740a1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 >> v1:172.21.15.73:6790/0 conn(0x7f4c74138d40 legacy=0x7f4c740a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient: _finish_hunting 0 2024-09-11T02:05:05.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 monclient: found mon.d 2024-09-11T02:05:05.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:05.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:05.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c74142810 con 0x7f4c740a72f0 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient: _finish_auth 0 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient: _check_auth_tickets 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c7b33d640 5 monclient: authenticate success, global_id 115737 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c7b33d640 10 monclient: _renew_subs 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c7b33d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7413b5d0 con 0x7f4c740a72f0 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c70004a90 con 0x7f4c740a72f0 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:05.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f4c70004f80 con 0x7f4c740a72f0 2024-09-11T02:05:05.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:05.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:05.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c69ffb640 10 monclient: dump: 2024-09-11T02:05:05.380 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:05.380 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:05.380 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.380 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:05.380 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:05.381 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:05.381 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:05.381 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:05.381 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:05.381 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:05.381 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c6b7fe640 4 set_mon_vals no callback set 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c7b33d640 10 monclient: _renew_subs 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c7b33d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.337+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c741d6f90 con 0x7f4c740a72f0 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.338+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f4c700116c0 con 0x7f4c740a72f0 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.338+0000 7f4c7b33d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.338+0000 7f4c7b33d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.338+0000 7f4c7b33d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:05.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.338+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c740aae30 con 0x7f4c740a72f0 2024-09-11T02:05:05.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.338+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f4c7004e110 con 0x7f4c740a72f0 2024-09-11T02:05:05.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.338+0000 7f4c788d8640 10 monclient: get_auth_request con 0x7f4c58040300 auth_method 0 2024-09-11T02:05:05.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.343+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f4c740aae30 con 0x7f4c740a72f0 2024-09-11T02:05:05.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.343+0000 7f4c69ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:05.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.343+0000 7f4c69ffb640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:05.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.520+0000 7f4c7b33d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-11T02:05:05.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.520+0000 7f4c7b33d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T02:05:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.520+0000 7f4c7b33d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.520+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 --> v1:172.21.15.73:6792/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c740aab40 con 0x7f4c740a72f0 2024-09-11T02:05:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.521+0000 7f4c69ffb640 1 -- 172.21.15.73:0/1334841849 <== mon.6 v1:172.21.15.73:6792/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v317) ==== 74+0+10878 (unknown 3688302649 0 2157904733) 0x7f4c740aab40 con 0x7f4c740a72f0 2024-09-11T02:05:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.521+0000 7f4c69ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-11T02:05:05.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.521+0000 7f4c69ffb640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:05.523 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T02:05:05.523 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":317,"fsid":"8cb5cb9a-3379-4e99-9a99-10d441f3d8e4","created":"2024-09-11T01:58:08.604820+0000","modified":"2024-09-11T02:05:02.620715+0000","last_up_change":"2024-09-11T01:58:19.924468+0000","last_in_change":"2024-09-11T01:58:10.229533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":100,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:58:20.893945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T01:58:25.343535+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0ed1d0ce-ed57-4eed-b684-5c04e84a8405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":3691603832}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":3691603832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":3691603832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":3691603832}]},"public_addr":"172.21.15.73:6804/3691603832","cluster_addr":"172.21.15.73:6805/3691603832","heartbeat_back_addr":"172.21.15.73:6807/3691603832","heartbeat_front_addr":"172.21.15.73:6806/3691603832","state":["exists","up"]},{"osd":1,"uuid":"3aa077b3-74c6-4609-8587-8a3c5ec8bc4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":2131770571}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":2131770571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":2131770571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":2131770571}]},"public_addr":"172.21.15.73:6800/2131770571","cluster_addr":"172.21.15.73:6801/2131770571","heartbeat_back_addr":"172.21.15.73:6803/2131770571","heartbeat_front_addr":"172.21.15.73:6802/2131770571","state":["exists","up"]},{"osd":2,"uuid":"063c664b-ce58-42bd-bd80-0d6b9721fcb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":2154209098}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":2154209098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":2154209098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":2154209098}]},"public_addr":"172.21.15.73:6808/2154209098","cluster_addr":"172.21.15.73:6809/2154209098","heartbeat_back_addr":"172.21.15.73:6811/2154209098","heartbeat_front_addr":"172.21.15.73:6810/2154209098","state":["exists","up"]},{"osd":3,"uuid":"12d01ea7-7a0e-4b5a-ac25-a6ba6af66458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6808","nonce":1861196202}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6809","nonce":1861196202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6811","nonce":1861196202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6810","nonce":1861196202}]},"public_addr":"172.21.15.203:6808/1861196202","cluster_addr":"172.21.15.203:6809/1861196202","heartbeat_back_addr":"172.21.15.203:6811/1861196202","heartbeat_front_addr":"172.21.15.203:6810/1861196202","state":["exists","up"]},{"osd":4,"uuid":"8b89af16-5602-4527-ba2c-b7142acac9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6804","nonce":1562443458}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6805","nonce":1562443458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6807","nonce":1562443458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6806","nonce":1562443458}]},"public_addr":"172.21.15.203:6804/1562443458","cluster_addr":"172.21.15.203:6805/1562443458","heartbeat_back_addr":"172.21.15.203:6807/1562443458","heartbeat_front_addr":"172.21.15.203:6806/1562443458","state":["exists","up"]},{"osd":5,"uuid":"ae991c5c-eac0-4bd2-8d87-7efa36a62abb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":314,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6800","nonce":464336651}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6801","nonce":464336651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6803","nonce":464336651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.203:6802","nonce":464336651}]},"public_addr":"172.21.15.203:6800/464336651","cluster_addr":"172.21.15.203:6801/464336651","heartbeat_back_addr":"172.21.15.203:6803/464336651","heartbeat_front_addr":"172.21.15.203:6802/464336651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.395799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.286329+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.691165+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.965210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.767253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:58:16.540222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T02:05:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.523+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 >> v1:172.21.15.203:6812/2311533528 conn(0x7f4c58040300 legacy=0x7f4c580427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.523+0000 7f4c7b33d640 10 monclient: shutdown 2024-09-11T02:05:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.523+0000 7f4c7b33d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.523+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 >> v1:172.21.15.73:6792/0 conn(0x7f4c740a72f0 legacy=0x7f4c740a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.523+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 shutdown_connections 2024-09-11T02:05:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.523+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 >> 172.21.15.73:0/1334841849 conn(0x7f4c740a8050 msgr2=0x7f4c7413ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.523+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 shutdown_connections 2024-09-11T02:05:05.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:05.523+0000 7f4c7b33d640 1 -- 172.21.15.73:0/1334841849 wait complete. 2024-09-11T02:05:06.536 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T02:05:06.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T02:05:06.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.645+0000 7f101d22a640 10 monclient: get_monmap_and_config 2024-09-11T02:05:06.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.645+0000 7f101d22a640 10 monclient: build_initial_monmap 2024-09-11T02:05:06.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.645+0000 7f101d22a640 10 monclient: monmap: 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:06.646029+0000 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:06.646029+0000 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:06.647 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:06.648 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.645+0000 7f101d22a640 1 Processor -- start 2024-09-11T02:05:06.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.645+0000 7f101d22a640 1 -- start start 2024-09-11T02:05:06.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.645+0000 7f101d22a640 10 monclient: init 2024-09-11T02:05:06.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:06.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 10 monclient: _add_conns ranks=[2,7,6,1,4,3,8,0,5] 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 10 monclient(hunting): picked mon.noname-b con 0x7f10180a5e20 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 10 monclient(hunting): picked mon.noname-i con 0x7f10180a7650 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 10 monclient(hunting): picked mon.noname-d con 0x7f10180a6910 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101809d030 con 0x7f10180a5e20 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101809d310 con 0x7f10180a6910 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101806f4e0 con 0x7f10180a7650 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 10 monclient(hunting): authenticate will time out at 1148.250329s 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1016d9d640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f10180a5e20 0x7f10180a6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41876/0 (socket says 172.21.15.73:41876) 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1016d9d640 1 -- 172.21.15.73:0/4030732836 learned_addr learned my addr 172.21.15.73:0/4030732836 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101759e640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f10180a6910 0x7f1018141760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50400/0 (socket says 172.21.15.73:50400) 2024-09-11T02:05:06.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197463433 0 0) 0x7f101809d030 con 0x7f10180a5e20 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): my global_id is 134966 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1004003520 con 0x7f10180a5e20 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262663813 0 0) 0x7f101809d310 con 0x7f10180a6910 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): my global_id is 115746 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101809d030 con 0x7f10180a6910 2024-09-11T02:05:06.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609889114 0 0) 0x7f101806f4e0 con 0x7f10180a7650 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient(hunting): my global_id is 6595 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101809d310 con 0x7f10180a7650 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3101981937 0 0) 0x7f101809d030 con 0x7f10180a6910 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 >> v1:172.21.15.203:6792/0 conn(0x7f10180a7650 legacy=0x7f101813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 >> v1:172.21.15.73:6790/0 conn(0x7f10180a5e20 legacy=0x7f10180a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient: _finish_hunting 0 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 monclient: found mon.noname-d 2024-09-11T02:05:06.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101809ca00 con 0x7f10180a6910 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient: _finish_auth 0 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 10 monclient: _check_auth_tickets 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1008001810 con 0x7f10180a6910 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.646+0000 7f101d22a640 5 monclient: authenticate success, global_id 115746 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f1015d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:06.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f1015d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f1015d9b640 10 monclient: dump: 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.660 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.661 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10080019b0 con 0x7f10180a6910 2024-09-11T02:05:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f1015d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f1015d9b640 1 -- 172.21.15.73:0/4030732836 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1008004b20 con 0x7f10180a6910 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f1015d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 4 set_mon_vals no callback set 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f1015d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f1015d9b640 10 monclient: dump: 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.662 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 10 monclient: shutdown 2024-09-11T02:05:06.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 1 -- 172.21.15.73:0/4030732836 >> v1:172.21.15.73:6792/0 conn(0x7f10180a6910 legacy=0x7f1018141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 1 -- 172.21.15.73:0/4030732836 shutdown_connections 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 1 -- 172.21.15.73:0/4030732836 >> 172.21.15.73:0/4030732836 conn(0x7f1018068ac0 msgr2=0x7f1018068ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 1 -- 172.21.15.73:0/4030732836 shutdown_connections 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.647+0000 7f101d22a640 1 -- 172.21.15.73:0/4030732836 wait complete. 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.648+0000 7f101d22a640 10 monclient: build_initial_monmap 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.648+0000 7f101d22a640 10 monclient: monmap: 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:06.664 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.648+0000 7f101d22a640 1 Processor -- start 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 1 -- start start 2024-09-11T02:05:06.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 10 monclient: init 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 10 monclient: _add_conns ranks=[3,6,5,4,0,2,8,1,7] 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 10 monclient(hunting): picked mon.noname-g con 0x7f10180a5e20 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 10 monclient(hunting): picked mon.noname-d con 0x7f10180a6910 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 10 monclient(hunting): picked mon.noname-h con 0x7f10180a7650 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1018141440 con 0x7f10180a5e20 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101806ef00 con 0x7f10180a7650 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101806e9f0 con 0x7f10180a6910 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101d22a640 10 monclient(hunting): authenticate will time out at 1148.253560s 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101659c640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f10180a6910 0x7f10181d2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50402/0 (socket says 172.21.15.73:50402) 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f101659c640 1 -- 172.21.15.73:0/1919421303 learned_addr learned my addr 172.21.15.73:0/1919421303 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816759159 0 0) 0x7f101806e9f0 con 0x7f10180a6910 2024-09-11T02:05:06.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f100f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f100f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f100f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f100f7fe640 10 monclient(hunting): my global_id is 115755 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.649+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ff8003550 con 0x7f10180a6910 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68758402 0 0) 0x7f1018141440 con 0x7f10180a5e20 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): my global_id is 6600 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101806e9f0 con 0x7f10180a5e20 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159726948 0 0) 0x7f101806ef00 con 0x7f10180a7650 2024-09-11T02:05:06.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): my global_id is 144239 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1018141440 con 0x7f10180a7650 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1893301808 0 0) 0x7f0ff8003550 con 0x7f10180a6910 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f101806ef00 con 0x7f10180a6910 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1000001a90 con 0x7f10180a6910 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.668 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.669 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.670 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.670 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.670 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:06.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2111387618 0 0) 0x7f101806ef00 con 0x7f10180a6910 2024-09-11T02:05:06.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 >> v1:172.21.15.203:6791/0 conn(0x7f10180a7650 legacy=0x7f10181d62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 >> v1:172.21.15.203:6790/0 conn(0x7f10180a5e20 legacy=0x7f1018139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:06.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 monclient: found mon.d 2024-09-11T02:05:06.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:06.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:06.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101813f0e0 con 0x7f10180a6910 2024-09-11T02:05:06.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:06.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:06.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:06.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f101d22a640 5 monclient: authenticate success, global_id 115755 2024-09-11T02:05:06.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f101d22a640 10 monclient: _renew_subs 2024-09-11T02:05:06.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f101d22a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:06.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1018141160 con 0x7f10180a6910 2024-09-11T02:05:06.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f101d22a640 10 monclient: _renew_subs 2024-09-11T02:05:06.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f101d22a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:06.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1018141bd0 con 0x7f10180a6910 2024-09-11T02:05:06.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1000001d30 con 0x7f10180a6910 2024-09-11T02:05:06.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1000003c00 con 0x7f10180a6910 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f101559a640 4 set_mon_vals no callback set 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.650+0000 7f100f7fe640 10 monclient: dump: 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.651+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f1000003e20 con 0x7f10180a6910 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.651+0000 7f101d22a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.651+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.73:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0ffc000f80 con 0x7f10180a6910 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.651+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f100004e330 con 0x7f10180a6910 2024-09-11T02:05:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.651+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.73:6804/3691603832 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ff804a820 con 0x7f0ff8046bb0 2024-09-11T02:05:06.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.651+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_get_version_reply(handle=1 version=317) ==== 24+0+0 (unknown 544367114 0 0) 0x7f1000016ce0 con 0x7f10180a6910 2024-09-11T02:05:06.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.651+0000 7f100f7fe640 10 monclient: handle_get_version_reply finishing 1 version 317 2024-09-11T02:05:06.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.651+0000 7f1016d9d640 10 monclient: get_auth_request con 0x7f0ff803ffb0 auth_method 0 2024-09-11T02:05:06.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.651+0000 7f101759e640 10 monclient: get_auth_request con 0x7f0ff8046bb0 auth_method 0 2024-09-11T02:05:06.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.652+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== osd.0 v1:172.21.15.73:6804/3691603832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f0ff804a820 con 0x7f0ff8046bb0 2024-09-11T02:05:06.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.664+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 --> v1:172.21.15.73:6804/3691603832 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0ffc002cd0 con 0x7f0ff8046bb0 2024-09-11T02:05:06.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.664+0000 7f100f7fe640 1 -- 172.21.15.73:0/1919421303 <== osd.0 v1:172.21.15.73:6804/3691603832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f0ffc002cd0 con 0x7f0ff8046bb0 2024-09-11T02:05:06.677 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:06.677 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T02:05:06.678 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:06.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 >> v1:172.21.15.73:6804/3691603832 conn(0x7f0ff8046bb0 legacy=0x7f0ff8048fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 >> v1:172.21.15.203:6812/2311533528 conn(0x7f0ff803ffb0 legacy=0x7f0ff8042470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101d22a640 10 monclient: shutdown 2024-09-11T02:05:06.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101d22a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:06.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 >> v1:172.21.15.73:6792/0 conn(0x7f10180a6910 legacy=0x7f10181d2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101759e640 1 -- 172.21.15.73:0/1919421303 reap_dead start 2024-09-11T02:05:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 shutdown_connections 2024-09-11T02:05:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 >> 172.21.15.73:0/1919421303 conn(0x7f1018068ac0 msgr2=0x7f10180a2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 shutdown_connections 2024-09-11T02:05:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.665+0000 7f101d22a640 1 -- 172.21.15.73:0/1919421303 wait complete. 2024-09-11T02:05:06.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T02:05:06.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.778+0000 7fb66da16640 10 monclient: get_monmap_and_config 2024-09-11T02:05:06.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.778+0000 7fb66da16640 10 monclient: build_initial_monmap 2024-09-11T02:05:06.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.778+0000 7fb66da16640 10 monclient: monmap: 2024-09-11T02:05:06.780 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:06.780 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:06.779212+0000 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:06.779212+0000 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:06.781 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:06.782 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:06.782 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:06.782 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 1 Processor -- start 2024-09-11T02:05:06.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 1 -- start start 2024-09-11T02:05:06.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 10 monclient: init 2024-09-11T02:05:06.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:06.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 10 monclient: _add_conns ranks=[1,5,2,7,4,6,0,8,3] 2024-09-11T02:05:06.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 10 monclient(hunting): picked mon.noname-f con 0x7fb668138d40 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 10 monclient(hunting): picked mon.noname-h con 0x7fb6680a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 10 monclient(hunting): picked mon.noname-b con 0x7fb66813f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66809ca00 con 0x7fb668138d40 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6680a7070 con 0x7fb66813f350 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66809cee0 con 0x7fb6680a72f0 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb66da16640 10 monclient(hunting): authenticate will time out at 1148.383671s 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb6677fe640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb66813f350 0x7fb668141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41890/0 (socket says 172.21.15.73:41890) 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb6677fe640 1 -- 172.21.15.73:0/2595577800 learned_addr learned my addr 172.21.15.73:0/2595577800 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:06.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.779+0000 7fb6667fc640 1 -- 172.21.15.73:0/2595577800 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160865116 0 0) 0x7fb6680a7070 con 0x7fb66813f350 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient(hunting): my global_id is 134975 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 1 -- 172.21.15.73:0/2595577800 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb654003520 con 0x7fb66813f350 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 1 -- 172.21.15.73:0/2595577800 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4057419953 0 0) 0x7fb654003520 con 0x7fb66813f350 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 1 -- 172.21.15.73:0/2595577800 >> v1:172.21.15.203:6791/0 conn(0x7fb6680a72f0 legacy=0x7fb66813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 1 -- 172.21.15.73:0/2595577800 >> v1:172.21.15.203:6789/0 conn(0x7fb668138d40 legacy=0x7fb668139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: _finish_hunting 0 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 1 monclient: found mon.noname-b 2024-09-11T02:05:06.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 1 -- 172.21.15.73:0/2595577800 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66809d1c0 con 0x7fb66813f350 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: _finish_auth 0 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: _check_auth_tickets 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 1 -- 172.21.15.73:0/2595577800 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb660001bb0 con 0x7fb66813f350 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: dump: 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.793 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.794 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb66da16640 5 monclient: authenticate success, global_id 134975 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb66da16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 1 -- 172.21.15.73:0/2595577800 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb660001dd0 con 0x7fb66813f350 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 1 -- 172.21.15.73:0/2595577800 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb660004f60 con 0x7fb66813f350 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb66da16640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb66da16640 4 set_mon_vals no callback set 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb6667fc640 10 monclient: dump: 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.795 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb66da16640 10 monclient: shutdown 2024-09-11T02:05:06.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb66da16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb66da16640 1 -- 172.21.15.73:0/2595577800 >> v1:172.21.15.73:6790/0 conn(0x7fb66813f350 legacy=0x7fb668141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb66da16640 1 -- 172.21.15.73:0/2595577800 shutdown_connections 2024-09-11T02:05:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.780+0000 7fb66da16640 1 -- 172.21.15.73:0/2595577800 >> 172.21.15.73:0/2595577800 conn(0x7fb6680a8050 msgr2=0x7fb6680a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.781+0000 7fb66da16640 1 -- 172.21.15.73:0/2595577800 shutdown_connections 2024-09-11T02:05:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.781+0000 7fb66da16640 1 -- 172.21.15.73:0/2595577800 wait complete. 2024-09-11T02:05:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.781+0000 7fb66da16640 10 monclient: build_initial_monmap 2024-09-11T02:05:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.781+0000 7fb66da16640 10 monclient: monmap: 2024-09-11T02:05:06.797 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:06.798 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.781+0000 7fb66da16640 1 Processor -- start 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.781+0000 7fb66da16640 1 -- start start 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.781+0000 7fb66da16640 10 monclient: init 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 10 monclient: _add_conns ranks=[4,2,6,3,5,8,7,0,1] 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 10 monclient(hunting): picked mon.noname-c con 0x7fb6680a72f0 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 10 monclient(hunting): picked mon.noname-b con 0x7fb668138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 10 monclient(hunting): picked mon.noname-d con 0x7fb66813f350 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66813ab60 con 0x7fb668138d40 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66813c620 con 0x7fb6680a72f0 2024-09-11T02:05:06.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66813c900 con 0x7fb66813f350 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb66da16640 10 monclient(hunting): authenticate will time out at 1148.386348s 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb65ffff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb668138d40 0x7fb66813a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41896/0 (socket says 172.21.15.73:41896) 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb65ffff640 1 -- 172.21.15.73:0/3782986494 learned_addr learned my addr 172.21.15.73:0/3782986494 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb666ffd640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fb6680a72f0 0x7fb6681399e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40396/0 (socket says 172.21.15.73:40396) 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748167273 0 0) 0x7fb66813ab60 con 0x7fb668138d40 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): my global_id is 134984 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb648003550 con 0x7fb668138d40 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439155792 0 0) 0x7fb66813c900 con 0x7fb66813f350 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): my global_id is 115764 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb66813ab60 con 0x7fb66813f350 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167353342 0 0) 0x7fb66813c620 con 0x7fb6680a72f0 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:06.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): my global_id is 6466 2024-09-11T02:05:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb66813c900 con 0x7fb6680a72f0 2024-09-11T02:05:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1364578137 0 0) 0x7fb648003550 con 0x7fb668138d40 2024-09-11T02:05:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb66813c620 con 0x7fb668138d40 2024-09-11T02:05:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb650001b70 con 0x7fb668138d40 2024-09-11T02:05:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:06.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): dump: 2024-09-11T02:05:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.803 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.804 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.805 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1320057303 0 0) 0x7fb66813ab60 con 0x7fb66813f350 2024-09-11T02:05:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb648003550 con 0x7fb66813f350 2024-09-11T02:05:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb6600013a0 con 0x7fb66813f350 2024-09-11T02:05:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:06.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.782+0000 7fb664ff9640 10 monclient(hunting): dump: 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 916193483 0 0) 0x7fb66813c900 con 0x7fb6680a72f0 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb66813ab60 con 0x7fb6680a72f0 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb658001a10 con 0x7fb6680a72f0 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient(hunting): dump: 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.808 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1294087912 0 0) 0x7fb66813c620 con 0x7fb668138d40 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 >> v1:172.21.15.73:6792/0 conn(0x7fb66813f350 legacy=0x7fb6681d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 >> v1:172.21.15.73:6791/0 conn(0x7fb6680a72f0 legacy=0x7fb6681399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 monclient: found mon.b 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66813cbe0 con 0x7fb668138d40 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient: _finish_auth 0 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb66da16640 5 monclient: authenticate success, global_id 134984 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb66da16640 10 monclient: _renew_subs 2024-09-11T02:05:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb66da16640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb66813e8c0 con 0x7fb668138d40 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb66da16640 10 monclient: _renew_subs 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb66da16640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb668141eb0 con 0x7fb668138d40 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6500038c0 con 0x7fb668138d40 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fb650003e30 con 0x7fb668138d40 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb665ffb640 4 set_mon_vals no callback set 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.783+0000 7fb664ff9640 10 monclient: dump: 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.784+0000 7fb66da16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.784+0000 7fb66da16640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.784+0000 7fb66da16640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.784+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64c005080 con 0x7fb668138d40 2024-09-11T02:05:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.784+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fb650003fd0 con 0x7fb668138d40 2024-09-11T02:05:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.784+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7fb65004e300 con 0x7fb668138d40 2024-09-11T02:05:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.784+0000 7fb666ffd640 10 monclient: get_auth_request con 0x7fb648040720 auth_method 0 2024-09-11T02:05:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.788+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fb6500175e0 con 0x7fb668138d40 2024-09-11T02:05:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.788+0000 7fb664ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.788+0000 7fb664ff9640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.964+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb64c000b90 con 0x7fb648040720 2024-09-11T02:05:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.964+0000 7fb664ff9640 1 -- 172.21.15.73:0/3782986494 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fb64c000b90 con 0x7fb648040720 2024-09-11T02:05:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T02:05:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.966+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 >> v1:172.21.15.203:6812/2311533528 conn(0x7fb648040720 legacy=0x7fb648042be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.966+0000 7fb66da16640 10 monclient: shutdown 2024-09-11T02:05:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.966+0000 7fb66da16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.966+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 >> v1:172.21.15.73:6790/0 conn(0x7fb668138d40 legacy=0x7fb66813a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.966+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 shutdown_connections 2024-09-11T02:05:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.966+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 >> 172.21.15.73:0/3782986494 conn(0x7fb6680a8050 msgr2=0x7fb6680a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.966+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 shutdown_connections 2024-09-11T02:05:06.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:06.966+0000 7fb66da16640 1 -- 172.21.15.73:0/3782986494 wait complete. 2024-09-11T02:05:06.978 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T02:05:06.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T02:05:07.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.078+0000 7f08589ad640 10 monclient: get_monmap_and_config 2024-09-11T02:05:07.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.078+0000 7f08589ad640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.078+0000 7f08589ad640 10 monclient: monmap: 2024-09-11T02:05:07.080 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.080 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.080 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:07.079735+0000 2024-09-11T02:05:07.080 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:07.079735+0000 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.081 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.079+0000 7f08589ad640 1 Processor -- start 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.079+0000 7f08589ad640 1 -- start start 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.079+0000 7f08589ad640 10 monclient: init 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 10 monclient: _add_conns ranks=[4,5,8,7,6,3,2,1,0] 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 10 monclient(hunting): picked mon.noname-c con 0x7f08540a5f00 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 10 monclient(hunting): picked mon.noname-h con 0x7f08540a69f0 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 10 monclient(hunting): picked mon.noname-e con 0x7f085409dec0 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08540a7c90 con 0x7f08540a5f00 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08540a7590 con 0x7f08540a69f0 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08540a7110 con 0x7f085409dec0 2024-09-11T02:05:07.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 10 monclient(hunting): authenticate will time out at 1148.684234s 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085259c640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f08540a5f00 0x7f08540a62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40400/0 (socket says 172.21.15.73:40400) 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085259c640 1 -- 172.21.15.73:0/4233762231 learned_addr learned my addr 172.21.15.73:0/4233762231 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768877002 0 0) 0x7f08540a7110 con 0x7f085409dec0 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient(hunting): my global_id is 115730 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0840003520 con 0x7f085409dec0 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069337758 0 0) 0x7f0844001110 con 0x7f08540a5f00 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient(hunting): my global_id is 6475 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08540a7110 con 0x7f08540a5f00 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1450025669 0 0) 0x7f0840003520 con 0x7f085409dec0 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 >> v1:172.21.15.203:6791/0 conn(0x7f08540a69f0 legacy=0x7f085413e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 >> v1:172.21.15.73:6791/0 conn(0x7f08540a5f00 legacy=0x7f08540a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 monclient: found mon.noname-e 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.73:6793/0 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085406f590 con 0x7f085409dec0 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f084c001bb0 con 0x7f085409dec0 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 5 monclient: authenticate success, global_id 115730 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: dump: 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.092 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 <== mon.8 v1:172.21.15.73:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f084c001d50 con 0x7f085409dec0 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 1 -- 172.21.15.73:0/4233762231 <== mon.8 v1:172.21.15.73:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f084c003cd0 con 0x7f085409dec0 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f08589ad640 4 set_mon_vals no callback set 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.080+0000 7f085159a640 10 monclient: dump: 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.094 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.081+0000 7f08589ad640 10 monclient: shutdown 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.081+0000 7f08589ad640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.081+0000 7f08589ad640 1 -- 172.21.15.73:0/4233762231 >> v1:172.21.15.73:6793/0 conn(0x7f085409dec0 legacy=0x7f0854141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.081+0000 7f08589ad640 1 -- 172.21.15.73:0/4233762231 shutdown_connections 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.081+0000 7f08589ad640 1 -- 172.21.15.73:0/4233762231 >> 172.21.15.73:0/4233762231 conn(0x7f08540ac140 msgr2=0x7f08540a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.081+0000 7f08589ad640 1 -- 172.21.15.73:0/4233762231 shutdown_connections 2024-09-11T02:05:07.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.081+0000 7f08589ad640 1 -- 172.21.15.73:0/4233762231 wait complete. 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.082+0000 7f08589ad640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.082+0000 7f08589ad640 10 monclient: monmap: 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.096 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.082+0000 7f08589ad640 1 Processor -- start 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.082+0000 7f08589ad640 1 -- start start 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.082+0000 7f08589ad640 10 monclient: init 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.082+0000 7f08589ad640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.082+0000 7f08589ad640 10 monclient: _add_conns ranks=[2,4,1,3,0,6,5,7,8] 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.082+0000 7f08589ad640 10 monclient(hunting): picked mon.noname-b con 0x7f085409dec0 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 10 monclient(hunting): picked mon.noname-c con 0x7f08540a5f00 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 10 monclient(hunting): picked mon.noname-f con 0x7f08540a69f0 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08540aacb0 con 0x7f08540a69f0 2024-09-11T02:05:07.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08541290b0 con 0x7f085409dec0 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0854126d50 con 0x7f08540a5f00 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 10 monclient(hunting): authenticate will time out at 1148.687066s 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f0851d9b640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f08540a5f00 0x7f08541d29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40406/0 (socket says 172.21.15.73:40406) 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f0851d9b640 1 -- 172.21.15.73:0/1351833244 learned_addr learned my addr 172.21.15.73:0/1351833244 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f085259c640 1 --1- 172.21.15.73:0/1351833244 >> v1:172.21.15.73:6790/0 conn(0x7f085409dec0 0x7f0854141750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41904/0 (socket says 172.21.15.73:41904) 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777345773 0 0) 0x7f0854126d50 con 0x7f08540a5f00 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): my global_id is 6484 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0834003550 con 0x7f08540a5f00 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076411170 0 0) 0x7f08541290b0 con 0x7f085409dec0 2024-09-11T02:05:07.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): my global_id is 134993 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0854126d50 con 0x7f085409dec0 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3837623541 0 0) 0x7f0834003550 con 0x7f08540a5f00 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08541290b0 con 0x7f08540a5f00 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f083c001a90 con 0x7f08540a5f00 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): dump: 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.099 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:07.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1993503607 0 0) 0x7f0854126d50 con 0x7f085409dec0 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0834003550 con 0x7f085409dec0 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0844001720 con 0x7f085409dec0 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): dump: 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.101 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371477698 0 0) 0x7f085406f590 con 0x7f08540a69f0 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient(hunting): my global_id is 144217 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0854126d50 con 0x7f08540a69f0 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3589876495 0 0) 0x7f08541290b0 con 0x7f08540a5f00 2024-09-11T02:05:07.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 >> v1:172.21.15.73:6790/0 conn(0x7f085409dec0 legacy=0x7f0854141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 >> v1:172.21.15.203:6789/0 conn(0x7f08540a69f0 legacy=0x7f08541d60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 monclient: found mon.c 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0854128810 con 0x7f08540a5f00 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 5 monclient: authenticate success, global_id 6484 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 10 monclient: _renew_subs 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0854141e60 con 0x7f08540a5f00 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 10 monclient: _renew_subs 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0854127a90 con 0x7f08540a5f00 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f083c0038c0 con 0x7f08540a5f00 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f083c003df0 con 0x7f08540a5f00 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f0850d99640 4 set_mon_vals no callback set 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.083+0000 7f084affd640 10 monclient: dump: 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.104 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.084+0000 7f08589ad640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.084+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0838000f80 con 0x7f08540a5f00 2024-09-11T02:05:07.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.084+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f083c003f90 con 0x7f08540a5f00 2024-09-11T02:05:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.084+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f083c04e270 con 0x7f08540a5f00 2024-09-11T02:05:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.085+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6800/2131770571 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f083404ac80 con 0x7f0834047010 2024-09-11T02:05:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.085+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_get_version_reply(handle=1 version=317) ==== 24+0+0 (unknown 544367114 0 0) 0x7f083c04e680 con 0x7f08540a5f00 2024-09-11T02:05:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.085+0000 7f084affd640 10 monclient: handle_get_version_reply finishing 1 version 317 2024-09-11T02:05:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.085+0000 7f085259c640 10 monclient: get_auth_request con 0x7f0834040430 auth_method 0 2024-09-11T02:05:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.085+0000 7f0852d9d640 10 monclient: get_auth_request con 0x7f0834047010 auth_method 0 2024-09-11T02:05:07.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.085+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== osd.1 v1:172.21.15.73:6800/2131770571 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f083404ac80 con 0x7f0834047010 2024-09-11T02:05:07.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 --> v1:172.21.15.73:6800/2131770571 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0838002cd0 con 0x7f0834047010 2024-09-11T02:05:07.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f084affd640 1 -- 172.21.15.73:0/1351833244 <== osd.1 v1:172.21.15.73:6800/2131770571 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f0838002cd0 con 0x7f0834047010 2024-09-11T02:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T02:05:07.109 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:07.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 >> v1:172.21.15.73:6800/2131770571 conn(0x7f0834047010 legacy=0x7f0834049430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 >> v1:172.21.15.203:6812/2311533528 conn(0x7f0834040430 legacy=0x7f08340428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 10 monclient: shutdown 2024-09-11T02:05:07.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 >> v1:172.21.15.73:6791/0 conn(0x7f08540a5f00 legacy=0x7f08541d29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f0852d9d640 1 -- 172.21.15.73:0/1351833244 reap_dead start 2024-09-11T02:05:07.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 shutdown_connections 2024-09-11T02:05:07.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 >> 172.21.15.73:0/1351833244 conn(0x7f08540ac140 msgr2=0x7f08540a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 shutdown_connections 2024-09-11T02:05:07.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.098+0000 7f08589ad640 1 -- 172.21.15.73:0/1351833244 wait complete. 2024-09-11T02:05:07.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T02:05:07.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.208+0000 7f3f30da3640 10 monclient: get_monmap_and_config 2024-09-11T02:05:07.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.208+0000 7f3f30da3640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.208+0000 7f3f30da3640 10 monclient: monmap: 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:07.209119+0000 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:07.209119+0000 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.210 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.211 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.211 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.211 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.211 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.208+0000 7f3f30da3640 1 Processor -- start 2024-09-11T02:05:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.208+0000 7f3f30da3640 1 -- start start 2024-09-11T02:05:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.208+0000 7f3f30da3640 10 monclient: init 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 10 monclient: _add_conns ranks=[0,3,7,2,8,5,6,1,4] 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 10 monclient(hunting): picked mon.noname-a con 0x7f3f2c138960 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 10 monclient(hunting): picked mon.noname-g con 0x7f3f2c139450 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 10 monclient(hunting): picked mon.noname-i con 0x7f3f2c13f620 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c09d030 con 0x7f3f2c138960 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c09d310 con 0x7f3f2c139450 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c06f770 con 0x7f3f2c13f620 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f30da3640 10 monclient(hunting): authenticate will time out at 1148.813519s 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f2a59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3f2c138960 0x7f3f2c138d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60402/0 (socket says 172.21.15.73:60402) 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f2a59c640 1 -- 172.21.15.73:0/3379987257 learned_addr learned my addr 172.21.15.73:0/3379987257 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519311902 0 0) 0x7f3f2c09d030 con 0x7f3f2c138960 2024-09-11T02:05:07.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f2959a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f2959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f2959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f2959a640 10 monclient(hunting): my global_id is 6741 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f14003520 con 0x7f3f2c138960 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.209+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458395813 0 0) 0x7f3f2c09d310 con 0x7f3f2c139450 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient(hunting): my global_id is 6609 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c09d030 con 0x7f3f2c139450 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463590001 0 0) 0x7f3f2c06f770 con 0x7f3f2c13f620 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient(hunting): my global_id is 6604 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c09d310 con 0x7f3f2c13f620 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1185764135 0 0) 0x7f3f14003520 con 0x7f3f2c138960 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 >> v1:172.21.15.203:6792/0 conn(0x7f3f2c13f620 legacy=0x7f3f2c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 >> v1:172.21.15.203:6790/0 conn(0x7f3f2c139450 legacy=0x7f3f2c13df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 monclient: found mon.noname-a 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c0a7360 con 0x7f3f2c138960 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f1c001830 con 0x7f3f2c138960 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 5 monclient: authenticate success, global_id 6741 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: dump: 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.222 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f1c0019d0 con 0x7f3f2c138960 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 1 -- 172.21.15.73:0/3379987257 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f1c004be0 con 0x7f3f2c138960 2024-09-11T02:05:07.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 4 set_mon_vals no callback set 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f2959a640 10 monclient: dump: 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 10 monclient: shutdown 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 1 -- 172.21.15.73:0/3379987257 >> v1:172.21.15.73:6789/0 conn(0x7f3f2c138960 legacy=0x7f3f2c138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 1 -- 172.21.15.73:0/3379987257 shutdown_connections 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 1 -- 172.21.15.73:0/3379987257 >> 172.21.15.73:0/3379987257 conn(0x7f3f2c0a8050 msgr2=0x7f3f2c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 1 -- 172.21.15.73:0/3379987257 shutdown_connections 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.210+0000 7f3f30da3640 1 -- 172.21.15.73:0/3379987257 wait complete. 2024-09-11T02:05:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.211+0000 7f3f30da3640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.211+0000 7f3f30da3640 10 monclient: monmap: 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.211+0000 7f3f30da3640 1 Processor -- start 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.211+0000 7f3f30da3640 1 -- start start 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.211+0000 7f3f30da3640 10 monclient: init 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 10 monclient: _add_conns ranks=[8,2,6,3,0,5,7,4,1] 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 10 monclient(hunting): picked mon.noname-e con 0x7f3f2c138960 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 10 monclient(hunting): picked mon.noname-b con 0x7f3f2c139450 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 10 monclient(hunting): picked mon.noname-d con 0x7f3f2c13f620 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c0a5350 con 0x7f3f2c139450 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c13cc10 con 0x7f3f2c13f620 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c13c370 con 0x7f3f2c138960 2024-09-11T02:05:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f30da3640 10 monclient(hunting): authenticate will time out at 1148.816452s 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f2a59c640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f3f2c138960 0x7f3f2c13e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35174/0 (socket says 172.21.15.73:35174) 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f29d9b640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f3f2c139450 0x7f3f2c1d2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41906/0 (socket says 172.21.15.73:41906) 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f2a59c640 1 -- 172.21.15.73:0/3588133712 learned_addr learned my addr 172.21.15.73:0/3588133712 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080332208 0 0) 0x7f3f2c0a5350 con 0x7f3f2c139450 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): my global_id is 135002 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f0c003520 con 0x7f3f2c139450 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219539494 0 0) 0x7f3f2c13c370 con 0x7f3f2c138960 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): my global_id is 115739 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c0a5350 con 0x7f3f2c138960 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223051859 0 0) 0x7f3f2c13cc10 con 0x7f3f2c13f620 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 10 monclient(hunting): my global_id is 115773 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c13c370 con 0x7f3f2c13f620 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.212+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2187138084 0 0) 0x7f3f0c003520 con 0x7f3f2c139450 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f2c13cc10 con 0x7f3f2c139450 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f20001b90 con 0x7f3f2c139450 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): dump: 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3981207747 0 0) 0x7f3f2c13c370 con 0x7f3f2c13f620 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f0c003520 con 0x7f3f2c13f620 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3811397616 0 0) 0x7f3f2c0a5350 con 0x7f3f2c138960 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f2c13c370 con 0x7f3f2c138960 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f24001c20 con 0x7f3f2c13f620 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): dump: 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f1c001770 con 0x7f3f2c138960 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient(hunting): dump: 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.233 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.234 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.234 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.234 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.234 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.234 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.234 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.234 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.234 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.234 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 910576518 0 0) 0x7f3f2c13cc10 con 0x7f3f2c139450 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 >> v1:172.21.15.73:6793/0 conn(0x7f3f2c138960 legacy=0x7f3f2c13e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 >> v1:172.21.15.73:6792/0 conn(0x7f3f2c13f620 legacy=0x7f3f2c1d5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 monclient: found mon.b 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c13c650 con 0x7f3f2c139450 2024-09-11T02:05:07.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f30da3640 5 monclient: authenticate success, global_id 135002 2024-09-11T02:05:07.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f30da3640 10 monclient: _renew_subs 2024-09-11T02:05:07.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f30da3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:07.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2c13b410 con 0x7f3f2c139450 2024-09-11T02:05:07.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f30da3640 10 monclient: _renew_subs 2024-09-11T02:05:07.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f30da3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:07.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3f2c1cd9b0 con 0x7f3f2c139450 2024-09-11T02:05:07.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f200038c0 con 0x7f3f2c139450 2024-09-11T02:05:07.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3f20003df0 con 0x7f3f2c139450 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f28d99640 4 set_mon_vals no callback set 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.213+0000 7f3f1affd640 10 monclient: dump: 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.238 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.214+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f3f20003f90 con 0x7f3f2c139450 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.214+0000 7f3f30da3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.214+0000 7f3f30da3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.214+0000 7f3f30da3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.214+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f10005080 con 0x7f3f2c139450 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.214+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f3f2004e360 con 0x7f3f2c139450 2024-09-11T02:05:07.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.214+0000 7f3f2a59c640 10 monclient: get_auth_request con 0x7f3f0c0406e0 auth_method 0 2024-09-11T02:05:07.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.218+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f3f20017660 con 0x7f3f2c139450 2024-09-11T02:05:07.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.218+0000 7f3f1affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:07.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.218+0000 7f3f1affd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.395+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3f10000b90 con 0x7f3f0c0406e0 2024-09-11T02:05:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.396+0000 7f3f1affd640 1 -- 172.21.15.73:0/3588133712 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f3f10000b90 con 0x7f3f0c0406e0 2024-09-11T02:05:07.397 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T02:05:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.398+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 >> v1:172.21.15.203:6812/2311533528 conn(0x7f3f0c0406e0 legacy=0x7f3f0c042ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.398+0000 7f3f30da3640 10 monclient: shutdown 2024-09-11T02:05:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.398+0000 7f3f30da3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.398+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 >> v1:172.21.15.73:6790/0 conn(0x7f3f2c139450 legacy=0x7f3f2c1d2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.398+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 shutdown_connections 2024-09-11T02:05:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.398+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 >> 172.21.15.73:0/3588133712 conn(0x7f3f2c0a8050 msgr2=0x7f3f2c0a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.398+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 shutdown_connections 2024-09-11T02:05:07.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.398+0000 7f3f30da3640 1 -- 172.21.15.73:0/3588133712 wait complete. 2024-09-11T02:05:07.410 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T02:05:07.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T02:05:07.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.511+0000 7f3de1c57640 10 monclient: get_monmap_and_config 2024-09-11T02:05:07.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.511+0000 7f3de1c57640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.511+0000 7f3de1c57640 10 monclient: monmap: 2024-09-11T02:05:07.513 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.513 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.513 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:07.512145+0000 2024-09-11T02:05:07.513 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:07.512145+0000 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 1 Processor -- start 2024-09-11T02:05:07.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 1 -- start start 2024-09-11T02:05:07.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 10 monclient: init 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 10 monclient: _add_conns ranks=[0,5,3,1,8,2,6,4,7] 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 10 monclient(hunting): picked mon.noname-a con 0x7f3ddc0a5e20 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 10 monclient(hunting): picked mon.noname-h con 0x7f3ddc0a6910 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 10 monclient(hunting): picked mon.noname-g con 0x7f3ddc09e850 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ddc09ca00 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ddc09cf50 con 0x7f3ddc09e850 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ddc074680 con 0x7f3ddc0a6910 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3de1c57640 10 monclient(hunting): authenticate will time out at 1149.116680s 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3ddb7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3ddc0a5e20 0x7f3ddc0a6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60416/0 (socket says 172.21.15.73:60416) 2024-09-11T02:05:07.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3ddb7fe640 1 -- 172.21.15.73:0/384225252 learned_addr learned my addr 172.21.15.73:0/384225252 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3dda7fc640 1 -- 172.21.15.73:0/384225252 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305862066 0 0) 0x7f3ddc09ca00 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3dda7fc640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3dda7fc640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3dda7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.512+0000 7f3dda7fc640 10 monclient(hunting): my global_id is 6750 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 1 -- 172.21.15.73:0/384225252 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dc4003520 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 1 -- 172.21.15.73:0/384225252 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2110599174 0 0) 0x7f3dc4003520 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 1 -- 172.21.15.73:0/384225252 >> v1:172.21.15.203:6791/0 conn(0x7f3ddc0a6910 legacy=0x7f3ddc1425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 1 -- 172.21.15.73:0/384225252 >> v1:172.21.15.203:6790/0 conn(0x7f3ddc09e850 legacy=0x7f3ddc145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 1 monclient: found mon.noname-a 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 1 -- 172.21.15.73:0/384225252 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ddc0a7930 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 1 -- 172.21.15.73:0/384225252 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3dcc001830 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 5 monclient: authenticate success, global_id 6750 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: dump: 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 1 -- 172.21.15.73:0/384225252 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3dcc001a50 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 1 -- 172.21.15.73:0/384225252 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3dcc004be0 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 4 set_mon_vals no callback set 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3dda7fc640 10 monclient: dump: 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 10 monclient: shutdown 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 1 -- 172.21.15.73:0/384225252 >> v1:172.21.15.73:6789/0 conn(0x7f3ddc0a5e20 legacy=0x7f3ddc0a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 1 -- 172.21.15.73:0/384225252 shutdown_connections 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 1 -- 172.21.15.73:0/384225252 >> 172.21.15.73:0/384225252 conn(0x7f3ddc068f10 msgr2=0x7f3ddc069320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 1 -- 172.21.15.73:0/384225252 shutdown_connections 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.513+0000 7f3de1c57640 1 -- 172.21.15.73:0/384225252 wait complete. 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.514+0000 7f3de1c57640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.514+0000 7f3de1c57640 10 monclient: monmap: 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.531 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.514+0000 7f3de1c57640 1 Processor -- start 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 1 -- start start 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 10 monclient: init 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 10 monclient: _add_conns ranks=[8,6,0,2,3,5,1,7,4] 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 10 monclient(hunting): picked mon.noname-e con 0x7f3ddc09e850 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 10 monclient(hunting): picked mon.noname-d con 0x7f3ddc0a5e20 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 10 monclient(hunting): picked mon.noname-a con 0x7f3ddc0a6910 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ddc13e250 con 0x7f3ddc0a6910 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ddc12ab60 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ddc0739a0 con 0x7f3ddc09e850 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3de1c57640 10 monclient(hunting): authenticate will time out at 1149.119517s 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3ddb7fe640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f3ddc09e850 0x7f3ddc13d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:35186/0 (socket says 172.21.15.73:35186) 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3ddb7fe640 1 -- 172.21.15.73:0/3863958532 learned_addr learned my addr 172.21.15.73:0/3863958532 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099994183 0 0) 0x7f3ddc074680 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): my global_id is 115782 2024-09-11T02:05:07.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dc8003520 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328455906 0 0) 0x7f3ddc09cf50 con 0x7f3ddc0a6910 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): my global_id is 6759 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ddc074680 con 0x7f3ddc0a6910 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840474714 0 0) 0x7f3ddc0739a0 con 0x7f3ddc09e850 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 10 monclient(hunting): my global_id is 115748 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.515+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ddc09cf50 con 0x7f3ddc09e850 2024-09-11T02:05:07.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2595391982 0 0) 0x7f3dc8003520 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ddc0739a0 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3dd00019c0 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): dump: 2024-09-11T02:05:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.535 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.536 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.537 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2201386005 0 0) 0x7f3ddc074680 con 0x7f3ddc0a6910 2024-09-11T02:05:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3dc8003520 con 0x7f3ddc0a6910 2024-09-11T02:05:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2167810322 0 0) 0x7f3ddc09cf50 con 0x7f3ddc09e850 2024-09-11T02:05:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ddc074680 con 0x7f3ddc09e850 2024-09-11T02:05:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3dd4001d50 con 0x7f3ddc0a6910 2024-09-11T02:05:07.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): dump: 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.538 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3dcc0010d0 con 0x7f3ddc09e850 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient(hunting): dump: 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.540 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.6 v1:172.21.15.73:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4103342518 0 0) 0x7f3ddc0739a0 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 >> v1:172.21.15.73:6793/0 conn(0x7f3ddc09e850 legacy=0x7f3ddc13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 >> v1:172.21.15.73:6789/0 conn(0x7f3ddc0a6910 legacy=0x7f3ddc1da4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 monclient: found mon.d 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ddc0a5500 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3de1c57640 5 monclient: authenticate success, global_id 115782 2024-09-11T02:05:07.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3de1c57640 10 monclient: _renew_subs 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3de1c57640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ddc12a280 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3de1c57640 10 monclient: _renew_subs 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3de1c57640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ddc071ad0 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.6 v1:172.21.15.73:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3dd0001ce0 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.6 v1:172.21.15.73:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f3dd0003be0 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dd9ffb640 4 set_mon_vals no callback set 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.516+0000 7f3dc3fff640 10 monclient: dump: 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.542 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.543 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.517+0000 7f3de1c57640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.73:6792/0 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.517+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3dbc000f80 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.517+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.6 v1:172.21.15.73:6792/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f3dd00103a0 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.517+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.6 v1:172.21.15.73:6792/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f3dd004d070 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.517+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6808/2154209098 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3dc804adc0 con 0x7f3dc8047150 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.517+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== mon.6 v1:172.21.15.73:6792/0 9 ==== mon_get_version_reply(handle=1 version=317) ==== 24+0+0 (unknown 544367114 0 0) 0x7f3dd004d540 con 0x7f3ddc0a5e20 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.517+0000 7f3dc3fff640 10 monclient: handle_get_version_reply finishing 1 version 317 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.517+0000 7f3ddb7fe640 10 monclient: get_auth_request con 0x7f3dc8040550 auth_method 0 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.517+0000 7f3ddbfff640 10 monclient: get_auth_request con 0x7f3dc8047150 auth_method 0 2024-09-11T02:05:07.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.518+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== osd.2 v1:172.21.15.73:6808/2154209098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f3dc804adc0 con 0x7f3dc8047150 2024-09-11T02:05:07.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.530+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 --> v1:172.21.15.73:6808/2154209098 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3dbc002cd0 con 0x7f3dc8047150 2024-09-11T02:05:07.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3dc3fff640 1 -- 172.21.15.73:0/3863958532 <== osd.2 v1:172.21.15.73:6808/2154209098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f3dbc002cd0 con 0x7f3dc8047150 2024-09-11T02:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T02:05:07.545 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 >> v1:172.21.15.73:6808/2154209098 conn(0x7f3dc8047150 legacy=0x7f3dc8049570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 >> v1:172.21.15.203:6812/2311533528 conn(0x7f3dc8040550 legacy=0x7f3dc8042a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3de1c57640 10 monclient: shutdown 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3de1c57640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 >> v1:172.21.15.73:6792/0 conn(0x7f3ddc0a5e20 legacy=0x7f3ddc1d6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3ddbfff640 1 -- 172.21.15.73:0/3863958532 reap_dead start 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 shutdown_connections 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 >> 172.21.15.73:0/3863958532 conn(0x7f3ddc068f10 msgr2=0x7f3ddc0a4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 shutdown_connections 2024-09-11T02:05:07.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.531+0000 7f3de1c57640 1 -- 172.21.15.73:0/3863958532 wait complete. 2024-09-11T02:05:07.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.646+0000 7f6f44365640 10 monclient: get_monmap_and_config 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.646+0000 7f6f44365640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.646+0000 7f6f44365640 10 monclient: monmap: 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:07.647033+0000 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:07.647033+0000 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.648 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.646+0000 7f6f44365640 1 Processor -- start 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.646+0000 7f6f44365640 1 -- start start 2024-09-11T02:05:07.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.646+0000 7f6f44365640 10 monclient: init 2024-09-11T02:05:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 10 monclient: _add_conns ranks=[3,0,5,1,8,7,4,2,6] 2024-09-11T02:05:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 10 monclient(hunting): picked mon.noname-g con 0x7f6f3c138d40 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 10 monclient(hunting): picked mon.noname-a con 0x7f6f3c0a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:07.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 10 monclient(hunting): picked mon.noname-h con 0x7f6f3c13f350 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3c09ca00 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3c0a7070 con 0x7f6f3c138d40 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3c09cee0 con 0x7f6f3c13f350 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f44365640 10 monclient(hunting): authenticate will time out at 1149.251545s 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f41900640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6f3c0a72f0 0x7f6f3c13dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60440/0 (socket says 172.21.15.73:60440) 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f41900640 1 -- 172.21.15.73:0/4071430159 learned_addr learned my addr 172.21.15.73:0/4071430159 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f410ff640 1 -- 172.21.15.73:0/4071430159 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098679435 0 0) 0x7f6f3c09ca00 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f410ff640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f410ff640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f410ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f410ff640 10 monclient(hunting): my global_id is 6768 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.647+0000 7f6f410ff640 1 -- 172.21.15.73:0/4071430159 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f28003520 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 1 -- 172.21.15.73:0/4071430159 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3425395610 0 0) 0x7f6f28003520 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 1 -- 172.21.15.73:0/4071430159 >> v1:172.21.15.203:6791/0 conn(0x7f6f3c13f350 legacy=0x7f6f3c141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 1 -- 172.21.15.73:0/4071430159 >> v1:172.21.15.203:6790/0 conn(0x7f6f3c138d40 legacy=0x7f6f3c139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 1 monclient: found mon.noname-a 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 1 -- 172.21.15.73:0/4071430159 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c09d1c0 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 1 -- 172.21.15.73:0/4071430159 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6f2c001850 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: dump: 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.659 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 5 monclient: authenticate success, global_id 6768 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 1 -- 172.21.15.73:0/4071430159 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f2c001a70 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 1 -- 172.21.15.73:0/4071430159 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6f2c004be0 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 4 set_mon_vals no callback set 2024-09-11T02:05:07.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f410ff640 10 monclient: dump: 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.661 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 10 monclient: shutdown 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 1 -- 172.21.15.73:0/4071430159 >> v1:172.21.15.73:6789/0 conn(0x7f6f3c0a72f0 legacy=0x7f6f3c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 1 -- 172.21.15.73:0/4071430159 shutdown_connections 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 1 -- 172.21.15.73:0/4071430159 >> 172.21.15.73:0/4071430159 conn(0x7f6f3c0a8050 msgr2=0x7f6f3c0a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 1 -- 172.21.15.73:0/4071430159 shutdown_connections 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.648+0000 7f6f44365640 1 -- 172.21.15.73:0/4071430159 wait complete. 2024-09-11T02:05:07.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.649+0000 7f6f44365640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.649+0000 7f6f44365640 10 monclient: monmap: 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.663 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.649+0000 7f6f44365640 1 Processor -- start 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.649+0000 7f6f44365640 1 -- start start 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.649+0000 7f6f44365640 10 monclient: init 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 10 monclient: _add_conns ranks=[0,4,2,5,3,6,7,8,1] 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 10 monclient(hunting): picked mon.noname-a con 0x7f6f3c0a72f0 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 10 monclient(hunting): picked mon.noname-c con 0x7f6f3c138d40 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 10 monclient(hunting): picked mon.noname-b con 0x7f6f3c13f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3c0a1ae0 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3c13b9c0 con 0x7f6f3c13f350 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f3c13ea00 con 0x7f6f3c138d40 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f44365640 10 monclient(hunting): authenticate will time out at 1149.254356s 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f42101640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6f3c0a72f0 0x7f6f3c0a0040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60452/0 (socket says 172.21.15.73:60452) 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f42101640 1 -- 172.21.15.73:0/3906174820 learned_addr learned my addr 172.21.15.73:0/3906174820 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579540241 0 0) 0x7f6f3c0a1ae0 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): my global_id is 6777 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f20003520 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069940125 0 0) 0x7f6f3c13b9c0 con 0x7f6f3c13f350 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): my global_id is 135011 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f3c0a1ae0 con 0x7f6f3c13f350 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996596917 0 0) 0x7f6f3c13ea00 con 0x7f6f3c138d40 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): my global_id is 6493 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f3c13b9c0 con 0x7f6f3c138d40 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 436428075 0 0) 0x7f6f20003520 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f3c13ea00 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6f38001b00 con 0x7f6f3c0a72f0 2024-09-11T02:05:07.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.667 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 290096650 0 0) 0x7f6f3c13b9c0 con 0x7f6f3c138d40 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f20003520 con 0x7f6f3c138d40 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2898381592 0 0) 0x7f6f3c0a1ae0 con 0x7f6f3c13f350 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f3c13b9c0 con 0x7f6f3c13f350 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6f2c004b20 con 0x7f6f3c138d40 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:07.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.650+0000 7f6f32ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.669 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6f34001cb0 con 0x7f6f3c13f350 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.670 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3575223768 0 0) 0x7f6f20003520 con 0x7f6f3c138d40 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 >> v1:172.21.15.73:6790/0 conn(0x7f6f3c13f350 legacy=0x7f6f3c0a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 >> v1:172.21.15.73:6789/0 conn(0x7f6f3c0a72f0 legacy=0x7f6f3c0a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 1 monclient: found mon.c 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c142860 con 0x7f6f3c138d40 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f44365640 5 monclient: authenticate success, global_id 6493 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f44365640 10 monclient: _renew_subs 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f44365640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f3c0a5310 con 0x7f6f3c138d40 2024-09-11T02:05:07.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f44365640 10 monclient: _renew_subs 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f44365640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f3c13a1c0 con 0x7f6f3c138d40 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f2c001830 con 0x7f6f3c138d40 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f6f2c001a20 con 0x7f6f3c138d40 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f408fe640 4 set_mon_vals no callback set 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.651+0000 7f6f32ffd640 10 monclient: dump: 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.673 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.652+0000 7f6f44365640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.652+0000 7f6f44365640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.652+0000 7f6f44365640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.652+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f6f2c011780 con 0x7f6f3c138d40 2024-09-11T02:05:07.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.652+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f24005080 con 0x7f6f3c138d40 2024-09-11T02:05:07.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.652+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f6f2c04e050 con 0x7f6f3c138d40 2024-09-11T02:05:07.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.652+0000 7f6f42101640 10 monclient: get_auth_request con 0x7f6f20040650 auth_method 0 2024-09-11T02:05:07.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.656+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f6f2c017330 con 0x7f6f3c138d40 2024-09-11T02:05:07.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.656+0000 7f6f32ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:07.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.656+0000 7f6f32ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:07.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.835+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f6f24000b90 con 0x7f6f20040650 2024-09-11T02:05:07.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.835+0000 7f6f32ffd640 1 -- 172.21.15.73:0/3906174820 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f6f24000b90 con 0x7f6f20040650 2024-09-11T02:05:07.838 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T02:05:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.838+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 >> v1:172.21.15.203:6812/2311533528 conn(0x7f6f20040650 legacy=0x7f6f20042b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.838+0000 7f6f44365640 10 monclient: shutdown 2024-09-11T02:05:07.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.838+0000 7f6f44365640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.838+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 >> v1:172.21.15.73:6791/0 conn(0x7f6f3c138d40 legacy=0x7f6f3c0a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.838+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 shutdown_connections 2024-09-11T02:05:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.838+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 >> 172.21.15.73:0/3906174820 conn(0x7f6f3c0a8050 msgr2=0x7f6f3c0a4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.838+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 shutdown_connections 2024-09-11T02:05:07.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.838+0000 7f6f44365640 1 -- 172.21.15.73:0/3906174820 wait complete. 2024-09-11T02:05:07.850 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T02:05:07.850 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T02:05:07.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.951+0000 7fce6e471640 10 monclient: get_monmap_and_config 2024-09-11T02:05:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.951+0000 7fce6e471640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.951+0000 7fce6e471640 10 monclient: monmap: 2024-09-11T02:05:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:07.951886+0000 2024-09-11T02:05:07.953 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:07.951886+0000 2024-09-11T02:05:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.954 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.955 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.955 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.951+0000 7fce6e471640 1 Processor -- start 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.951+0000 7fce6e471640 1 -- start start 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.951+0000 7fce6e471640 10 monclient: init 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 10 monclient: _add_conns ranks=[7,0,5,3,2,1,8,6,4] 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 10 monclient(hunting): picked mon.noname-i con 0x7fce680a5e20 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 10 monclient(hunting): picked mon.noname-a con 0x7fce6809dcc0 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 10 monclient(hunting): picked mon.noname-h con 0x7fce680a6910 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce680a7ce0 con 0x7fce6809dcc0 2024-09-11T02:05:07.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6809d2e0 con 0x7fce680a6910 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce680a7680 con 0x7fce680a5e20 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce6e471640 10 monclient(hunting): authenticate will time out at 1149.556397s 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce677fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fce6809dcc0 0x7fce6813e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60464/0 (socket says 172.21.15.73:60464) 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce677fe640 1 -- 172.21.15.73:0/1627452361 learned_addr learned my addr 172.21.15.73:0/1627452361 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77939101 0 0) 0x7fce680a7ce0 con 0x7fce6809dcc0 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient(hunting): my global_id is 6786 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce50003520 con 0x7fce6809dcc0 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025047845 0 0) 0x7fce680a7680 con 0x7fce680a5e20 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient(hunting): my global_id is 6613 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce680a7ce0 con 0x7fce680a5e20 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 792611226 0 0) 0x7fce50003520 con 0x7fce6809dcc0 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 >> v1:172.21.15.203:6792/0 conn(0x7fce680a5e20 legacy=0x7fce680a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 >> v1:172.21.15.203:6791/0 conn(0x7fce680a6910 legacy=0x7fce68141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 1 monclient: found mon.noname-a 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6809ca00 con 0x7fce6809dcc0 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.952+0000 7fce66ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fce5c0017b0 con 0x7fce6809dcc0 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 5 monclient: authenticate success, global_id 6786 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 10 monclient: dump: 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.967 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fce5c001950 con 0x7fce6809dcc0 2024-09-11T02:05:07.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 1 -- 172.21.15.73:0/1627452361 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fce5c004be0 con 0x7fce6809dcc0 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 4 set_mon_vals no callback set 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce66ffd640 10 monclient: dump: 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.969 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 10 monclient: shutdown 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 1 -- 172.21.15.73:0/1627452361 >> v1:172.21.15.73:6789/0 conn(0x7fce6809dcc0 legacy=0x7fce6813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 1 -- 172.21.15.73:0/1627452361 shutdown_connections 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 1 -- 172.21.15.73:0/1627452361 >> 172.21.15.73:0/1627452361 conn(0x7fce680a7f20 msgr2=0x7fce680a8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 1 -- 172.21.15.73:0/1627452361 shutdown_connections 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.953+0000 7fce6e471640 1 -- 172.21.15.73:0/1627452361 wait complete. 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.954+0000 7fce6e471640 10 monclient: build_initial_monmap 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.954+0000 7fce6e471640 10 monclient: monmap: 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:07.971 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.954+0000 7fce6e471640 1 Processor -- start 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.954+0000 7fce6e471640 1 -- start start 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.954+0000 7fce6e471640 10 monclient: init 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 10 monclient: _add_conns ranks=[4,5,7,3,1,6,2,0,8] 2024-09-11T02:05:07.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 10 monclient(hunting): picked mon.noname-c con 0x7fce6809dcc0 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 10 monclient(hunting): picked mon.noname-h con 0x7fce680a5e20 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 10 monclient(hunting): picked mon.noname-i con 0x7fce680a6910 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce680a52a0 con 0x7fce6809dcc0 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6806eb80 con 0x7fce680a5e20 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce68126d00 con 0x7fce680a6910 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 10 monclient(hunting): authenticate will time out at 1149.559267s 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce67fff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fce6809dcc0 0x7fce68141700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40430/0 (socket says 172.21.15.73:40430) 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce67fff640 1 -- 172.21.15.73:0/2173249200 learned_addr learned my addr 172.21.15.73:0/2173249200 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100022873 0 0) 0x7fce680a52a0 con 0x7fce6809dcc0 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): my global_id is 6502 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce54003520 con 0x7fce6809dcc0 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372732384 0 0) 0x7fce6806eb80 con 0x7fce680a5e20 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): my global_id is 144293 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce680a52a0 con 0x7fce680a5e20 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338297023 0 0) 0x7fce68126d00 con 0x7fce680a6910 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _negotiate 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): my global_id is 6622 2024-09-11T02:05:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce6806eb80 con 0x7fce680a6910 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 878975737 0 0) 0x7fce54003520 con 0x7fce6809dcc0 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fce68126d00 con 0x7fce6809dcc0 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fce58001bb0 con 0x7fce6809dcc0 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): dump: 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1988857243 0 0) 0x7fce68126d00 con 0x7fce6809dcc0 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 >> v1:172.21.15.203:6792/0 conn(0x7fce680a6910 legacy=0x7fce681d5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 >> v1:172.21.15.203:6791/0 conn(0x7fce680a5e20 legacy=0x7fce681d27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient: _finish_hunting 0 2024-09-11T02:05:07.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 monclient: found mon.c 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce681287c0 con 0x7fce6809dcc0 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient: _finish_auth 0 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 10 monclient: _check_auth_tickets 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce64ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 5 monclient: authenticate success, global_id 6502 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 10 monclient: _renew_subs 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.955+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fce68141e10 con 0x7fce6809dcc0 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce6e471640 10 monclient: _renew_subs 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce6e471640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fce68127a40 con 0x7fce6809dcc0 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fce580038c0 con 0x7fce6809dcc0 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce64ff9640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fce58003eb0 con 0x7fce6809dcc0 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce64ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce64ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce64ff9640 10 monclient: dump: 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce667fc640 4 set_mon_vals no callback set 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fce58004050 con 0x7fce6809dcc0 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce6e471640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.956+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.73:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fce680008d0 con 0x7fce6809dcc0 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.957+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7fce5804e240 con 0x7fce6809dcc0 2024-09-11T02:05:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.957+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.203:6808/1861196202 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce5404a530 con 0x7fce540468c0 2024-09-11T02:05:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.957+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_get_version_reply(handle=1 version=317) ==== 24+0+0 (unknown 544367114 0 0) 0x7fce58004370 con 0x7fce6809dcc0 2024-09-11T02:05:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.957+0000 7fce64ff9640 10 monclient: handle_get_version_reply finishing 1 version 317 2024-09-11T02:05:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.957+0000 7fce677fe640 10 monclient: get_auth_request con 0x7fce5403fcc0 auth_method 0 2024-09-11T02:05:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.957+0000 7fce6ca0e640 10 monclient: get_auth_request con 0x7fce540468c0 auth_method 0 2024-09-11T02:05:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.958+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== osd.3 v1:172.21.15.203:6808/1861196202 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fce5404a530 con 0x7fce540468c0 2024-09-11T02:05:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.970+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 --> v1:172.21.15.203:6808/1861196202 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fce681cdb60 con 0x7fce540468c0 2024-09-11T02:05:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce64ff9640 1 -- 172.21.15.73:0/2173249200 <== osd.3 v1:172.21.15.203:6808/1861196202 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fce681cdb60 con 0x7fce540468c0 2024-09-11T02:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T02:05:07.981 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 >> v1:172.21.15.203:6808/1861196202 conn(0x7fce540468c0 legacy=0x7fce54048ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 >> v1:172.21.15.203:6812/2311533528 conn(0x7fce5403fcc0 legacy=0x7fce54042180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6e471640 10 monclient: shutdown 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6e471640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 >> v1:172.21.15.73:6791/0 conn(0x7fce6809dcc0 legacy=0x7fce68141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6ca0e640 1 -- 172.21.15.73:0/2173249200 reap_dead start 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 shutdown_connections 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 >> 172.21.15.73:0/2173249200 conn(0x7fce680a7f20 msgr2=0x7fce6809eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 shutdown_connections 2024-09-11T02:05:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:07.971+0000 7fce6e471640 1 -- 172.21.15.73:0/2173249200 wait complete. 2024-09-11T02:05:07.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T02:05:08.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.080+0000 7efcd8640640 10 monclient: get_monmap_and_config 2024-09-11T02:05:08.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.080+0000 7efcd8640640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.080+0000 7efcd8640640 10 monclient: monmap: 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:08.081024+0000 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:08.081024+0000 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.083 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.083 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.080+0000 7efcd8640640 1 Processor -- start 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.080+0000 7efcd8640640 1 -- start start 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.080+0000 7efcd8640640 10 monclient: init 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 10 monclient: _add_conns ranks=[7,5,2,4,6,1,8,0,3] 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 10 monclient(hunting): picked mon.noname-i con 0x7efcd0138d40 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 10 monclient(hunting): picked mon.noname-h con 0x7efcd00a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 10 monclient(hunting): picked mon.noname-b con 0x7efcd013f350 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd009ca00 con 0x7efcd013f350 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd00a7070 con 0x7efcd00a72f0 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd009cee0 con 0x7efcd0138d40 2024-09-11T02:05:08.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd8640640 10 monclient(hunting): authenticate will time out at 1149.685589s 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd6bdd640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7efcd013f350 0x7efcd0141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41928/0 (socket says 172.21.15.73:41928) 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd6bdd640 1 -- 172.21.15.73:0/502019418 learned_addr learned my addr 172.21.15.73:0/502019418 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1538061665 0 0) 0x7efcd009ca00 con 0x7efcd013f350 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd53da640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd53da640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd53da640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd53da640 10 monclient(hunting): my global_id is 135020 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.081+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcbc003520 con 0x7efcd013f350 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2203101600 0 0) 0x7efcd00a7070 con 0x7efcd00a72f0 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient(hunting): my global_id is 144302 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcd009ca00 con 0x7efcd00a72f0 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1170259961 0 0) 0x7efcd009cee0 con 0x7efcd0138d40 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient(hunting): my global_id is 6631 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcd00a7070 con 0x7efcd0138d40 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3272917281 0 0) 0x7efcbc003520 con 0x7efcd013f350 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 >> v1:172.21.15.203:6792/0 conn(0x7efcd0138d40 legacy=0x7efcd0139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 >> v1:172.21.15.203:6791/0 conn(0x7efcd00a72f0 legacy=0x7efcd013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 monclient: found mon.noname-b 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd009d1c0 con 0x7efcd013f350 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efcc8001bd0 con 0x7efcd013f350 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 5 monclient: authenticate success, global_id 135020 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: dump: 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.095 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcc8001d70 con 0x7efcd013f350 2024-09-11T02:05:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 1 -- 172.21.15.73:0/502019418 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efcc8004f60 con 0x7efcd013f350 2024-09-11T02:05:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 4 set_mon_vals no callback set 2024-09-11T02:05:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd53da640 10 monclient: dump: 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 10 monclient: shutdown 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 1 -- 172.21.15.73:0/502019418 >> v1:172.21.15.73:6790/0 conn(0x7efcd013f350 legacy=0x7efcd0141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 1 -- 172.21.15.73:0/502019418 shutdown_connections 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 1 -- 172.21.15.73:0/502019418 >> 172.21.15.73:0/502019418 conn(0x7efcd00a8050 msgr2=0x7efcd00a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 1 -- 172.21.15.73:0/502019418 shutdown_connections 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.082+0000 7efcd8640640 1 -- 172.21.15.73:0/502019418 wait complete. 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.083+0000 7efcd8640640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.083+0000 7efcd8640640 10 monclient: monmap: 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.083+0000 7efcd8640640 1 Processor -- start 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.083+0000 7efcd8640640 1 -- start start 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.083+0000 7efcd8640640 10 monclient: init 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 10 monclient: _add_conns ranks=[7,3,0,6,4,8,5,2,1] 2024-09-11T02:05:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 10 monclient(hunting): picked mon.noname-i con 0x7efcd00a72f0 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 10 monclient(hunting): picked mon.noname-g con 0x7efcd0138d40 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 10 monclient(hunting): picked mon.noname-a con 0x7efcd013f350 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd013ba60 con 0x7efcd013f350 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd00a5450 con 0x7efcd0138d40 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd00a1b00 con 0x7efcd00a72f0 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd8640640 10 monclient(hunting): authenticate will time out at 1149.688324s 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd6bdd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efcd013f350 0x7efcd00a0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60468/0 (socket says 172.21.15.73:60468) 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcd6bdd640 1 -- 172.21.15.73:0/2760816068 learned_addr learned my addr 172.21.15.73:0/2760816068 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430018385 0 0) 0x7efcd013ba60 con 0x7efcd013f350 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): my global_id is 6795 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb4003550 con 0x7efcd013f350 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825678328 0 0) 0x7efcd00a1b00 con 0x7efcd00a72f0 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): my global_id is 6640 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcd013ba60 con 0x7efcd00a72f0 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035541754 0 0) 0x7efcd00a5450 con 0x7efcd0138d40 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): my global_id is 6636 2024-09-11T02:05:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcd00a1b00 con 0x7efcd0138d40 2024-09-11T02:05:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3662361744 0 0) 0x7efcb4003550 con 0x7efcd013f350 2024-09-11T02:05:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcd00a5450 con 0x7efcd013f350 2024-09-11T02:05:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efcc8004b60 con 0x7efcd013f350 2024-09-11T02:05:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.103 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.084+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3699051375 0 0) 0x7efcd013ba60 con 0x7efcd00a72f0 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcb4003550 con 0x7efcd00a72f0 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efccc001a00 con 0x7efcd00a72f0 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.104 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.105 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.106 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.107 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 495265132 0 0) 0x7efcd00a5450 con 0x7efcd013f350 2024-09-11T02:05:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 >> v1:172.21.15.203:6792/0 conn(0x7efcd00a72f0 legacy=0x7efcd00a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 >> v1:172.21.15.203:6790/0 conn(0x7efcd0138d40 legacy=0x7efcd00a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 monclient: found mon.a 2024-09-11T02:05:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd013b1c0 con 0x7efcd013f350 2024-09-11T02:05:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcd8640640 5 monclient: authenticate success, global_id 6795 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcd8640640 10 monclient: _renew_subs 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcd8640640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efcd013a450 con 0x7efcd013f350 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcd8640640 10 monclient: _renew_subs 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcd8640640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efcd01d6db0 con 0x7efcd013f350 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcc8004fb0 con 0x7efcd013f350 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7efcc8001bf0 con 0x7efcd013f350 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcd4bd9640 4 set_mon_vals no callback set 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 10 monclient: dump: 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.110 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.085+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7efcc8011a40 con 0x7efcd013f350 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.086+0000 7efcd8640640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.086+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7efcc804e470 con 0x7efcd013f350 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.086+0000 7efcd8640640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.086+0000 7efcd8640640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.086+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb8005080 con 0x7efcd013f350 2024-09-11T02:05:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.086+0000 7efcd63dc640 10 monclient: get_auth_request con 0x7efcb40404e0 auth_method 0 2024-09-11T02:05:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.090+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7efcc80176f0 con 0x7efcd013f350 2024-09-11T02:05:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.090+0000 7efcc2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.090+0000 7efcc2ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:08.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.269+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7efcb8000b90 con 0x7efcb40404e0 2024-09-11T02:05:08.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.270+0000 7efcc2ffd640 1 -- 172.21.15.73:0/2760816068 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7efcb8000b90 con 0x7efcb40404e0 2024-09-11T02:05:08.272 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T02:05:08.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.272+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 >> v1:172.21.15.203:6812/2311533528 conn(0x7efcb40404e0 legacy=0x7efcb40429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.272+0000 7efcd8640640 10 monclient: shutdown 2024-09-11T02:05:08.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.272+0000 7efcd8640640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:08.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.272+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 >> v1:172.21.15.73:6789/0 conn(0x7efcd013f350 legacy=0x7efcd00a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.272+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 shutdown_connections 2024-09-11T02:05:08.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.272+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 >> 172.21.15.73:0/2760816068 conn(0x7efcd00a8050 msgr2=0x7efcd00a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:08.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.272+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 shutdown_connections 2024-09-11T02:05:08.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.272+0000 7efcd8640640 1 -- 172.21.15.73:0/2760816068 wait complete. 2024-09-11T02:05:08.284 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T02:05:08.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T02:05:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.384+0000 7fab0d1ec640 10 monclient: get_monmap_and_config 2024-09-11T02:05:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.384+0000 7fab0d1ec640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.385+0000 7fab0d1ec640 10 monclient: monmap: 2024-09-11T02:05:08.386 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:08.385844+0000 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:08.385844+0000 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.387 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.385+0000 7fab0d1ec640 1 Processor -- start 2024-09-11T02:05:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.385+0000 7fab0d1ec640 1 -- start start 2024-09-11T02:05:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.385+0000 7fab0d1ec640 10 monclient: init 2024-09-11T02:05:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 10 monclient: _add_conns ranks=[6,7,1,8,3,0,5,4,2] 2024-09-11T02:05:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 10 monclient(hunting): picked mon.noname-d con 0x7fab080a5f00 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 10 monclient(hunting): picked mon.noname-i con 0x7fab0809de70 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:08.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 10 monclient(hunting): picked mon.noname-f con 0x7fab080a69f0 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab080a7390 con 0x7fab080a69f0 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab0809d120 con 0x7fab080a5f00 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab080a89e0 con 0x7fab0809de70 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 10 monclient(hunting): authenticate will time out at 1149.990292s 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab06d9d640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7fab080a5f00 0x7fab080a62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:50442/0 (socket says 172.21.15.73:50442) 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab06d9d640 1 -- 172.21.15.73:0/543620772 learned_addr learned my addr 172.21.15.73:0/543620772 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 -- 172.21.15.73:0/543620772 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3663416359 0 0) 0x7fab0809d120 con 0x7fab080a5f00 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient(hunting): my global_id is 115791 2024-09-11T02:05:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 -- 172.21.15.73:0/543620772 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaf4003520 con 0x7fab080a5f00 2024-09-11T02:05:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 -- 172.21.15.73:0/543620772 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 554781097 0 0) 0x7faaf4003520 con 0x7fab080a5f00 2024-09-11T02:05:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 -- 172.21.15.73:0/543620772 >> v1:172.21.15.203:6792/0 conn(0x7fab0809de70 legacy=0x7fab0813e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 -- 172.21.15.73:0/543620772 >> v1:172.21.15.203:6789/0 conn(0x7fab080a69f0 legacy=0x7fab08141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 monclient: found mon.noname-d 2024-09-11T02:05:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:05:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 -- 172.21.15.73:0/543620772 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab080a76a0 con 0x7fab080a5f00 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 -- 172.21.15.73:0/543620772 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab00001830 con 0x7fab080a5f00 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: dump: 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.400 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 5 monclient: authenticate success, global_id 115791 2024-09-11T02:05:08.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 -- 172.21.15.73:0/543620772 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab00001a50 con 0x7fab080a5f00 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 1 -- 172.21.15.73:0/543620772 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab00004be0 con 0x7fab080a5f00 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab0d1ec640 4 set_mon_vals no callback set 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.386+0000 7fab05d9b640 10 monclient: dump: 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.402 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.387+0000 7fab0d1ec640 10 monclient: shutdown 2024-09-11T02:05:08.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.387+0000 7fab0d1ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.387+0000 7fab0d1ec640 1 -- 172.21.15.73:0/543620772 >> v1:172.21.15.73:6792/0 conn(0x7fab080a5f00 legacy=0x7fab080a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.387+0000 7fab0d1ec640 1 -- 172.21.15.73:0/543620772 shutdown_connections 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.387+0000 7fab0d1ec640 1 -- 172.21.15.73:0/543620772 >> 172.21.15.73:0/543620772 conn(0x7fab080abf50 msgr2=0x7fab080a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.387+0000 7fab0d1ec640 1 -- 172.21.15.73:0/543620772 shutdown_connections 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.387+0000 7fab0d1ec640 1 -- 172.21.15.73:0/543620772 wait complete. 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.388+0000 7fab0d1ec640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.388+0000 7fab0d1ec640 10 monclient: monmap: 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:08.404 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.388+0000 7fab0d1ec640 1 Processor -- start 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.388+0000 7fab0d1ec640 1 -- start start 2024-09-11T02:05:08.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.388+0000 7fab0d1ec640 10 monclient: init 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient: _add_conns ranks=[0,2,3,4,5,8,1,7,6] 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient(hunting): picked mon.noname-a con 0x7fab0809de70 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient(hunting): picked mon.noname-b con 0x7fab080a5f00 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient(hunting): picked mon.noname-g con 0x7fab080a69f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab081292f0 con 0x7fab0809de70 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab080a53f0 con 0x7fab080a5f00 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab08128480 con 0x7fab080a69f0 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient(hunting): authenticate will time out at 1149.993115s 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab06d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fab0809de70 0x7fab08125560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60480/0 (socket says 172.21.15.73:60480) 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab06d9d640 1 -- 172.21.15.73:0/97368551 learned_addr learned my addr 172.21.15.73:0/97368551 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2870230516 0 0) 0x7fab081292f0 con 0x7fab0809de70 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): my global_id is 6804 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae8003550 con 0x7fab0809de70 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3992061094 0 0) 0x7fab080a53f0 con 0x7fab080a5f00 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): my global_id is 135029 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab081292f0 con 0x7fab080a5f00 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577196330 0 0) 0x7fab08128480 con 0x7fab080a69f0 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): my global_id is 6645 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab080a53f0 con 0x7fab080a69f0 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3865397539 0 0) 0x7faae8003550 con 0x7fab0809de70 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab08128480 con 0x7fab0809de70 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab00004b20 con 0x7fab0809de70 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.408 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:08.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1061513075 0 0) 0x7fab081292f0 con 0x7fab080a5f00 2024-09-11T02:05:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faae8003550 con 0x7fab080a5f00 2024-09-11T02:05:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7faaf0001900 con 0x7fab080a5f00 2024-09-11T02:05:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.410 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1924745671 0 0) 0x7fab080a53f0 con 0x7fab080a69f0 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab081292f0 con 0x7fab080a69f0 2024-09-11T02:05:08.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7faaf8001c30 con 0x7fab080a69f0 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.412 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1906167327 0 0) 0x7fab08128480 con 0x7fab0809de70 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 >> v1:172.21.15.203:6790/0 conn(0x7fab080a69f0 legacy=0x7fab081d60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 >> v1:172.21.15.73:6790/0 conn(0x7fab080a5f00 legacy=0x7fab08125c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 monclient: found mon.a 2024-09-11T02:05:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab08126f90 con 0x7fab0809de70 2024-09-11T02:05:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7faaff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 5 monclient: authenticate success, global_id 6804 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient: _renew_subs 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fab08128a50 con 0x7fab0809de70 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient: _renew_subs 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.389+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fab08141ea0 con 0x7fab0809de70 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab00004ea0 con 0x7fab0809de70 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7faaff7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fab00005390 con 0x7fab0809de70 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7faaff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7faaff7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7faaff7fe640 10 monclient: dump: 2024-09-11T02:05:08.415 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.416 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7fab0559a640 4 set_mon_vals no callback set 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7fab0d1ec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fab080698f0 con 0x7fab0809de70 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.390+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fab00011ad0 con 0x7fab0809de70 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.391+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7fab0004e260 con 0x7fab0809de70 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.391+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.203:6804/1562443458 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faae804af50 con 0x7faae80472e0 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.391+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=317) ==== 24+0+0 (unknown 544367114 0 0) 0x7fab0004e730 con 0x7fab0809de70 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.391+0000 7faaff7fe640 10 monclient: handle_get_version_reply finishing 1 version 317 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.391+0000 7fab0659c640 10 monclient: get_auth_request con 0x7faae8040700 auth_method 0 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.391+0000 7fab0759e640 10 monclient: get_auth_request con 0x7faae80472e0 auth_method 0 2024-09-11T02:05:08.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.392+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== osd.4 v1:172.21.15.203:6804/1562443458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7faae804af50 con 0x7faae80472e0 2024-09-11T02:05:08.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.404+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 --> v1:172.21.15.203:6804/1562443458 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fab081265d0 con 0x7faae80472e0 2024-09-11T02:05:08.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7faaff7fe640 1 -- 172.21.15.73:0/97368551 <== osd.4 v1:172.21.15.203:6804/1562443458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fab081265d0 con 0x7faae80472e0 2024-09-11T02:05:08.418 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:08.419 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T02:05:08.419 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:08.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 >> v1:172.21.15.203:6804/1562443458 conn(0x7faae80472e0 legacy=0x7faae8049700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 >> v1:172.21.15.203:6812/2311533528 conn(0x7faae8040700 legacy=0x7faae8042bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0d1ec640 10 monclient: shutdown 2024-09-11T02:05:08.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0d1ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:08.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 >> v1:172.21.15.73:6789/0 conn(0x7fab0809de70 legacy=0x7fab08125560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0759e640 1 -- 172.21.15.73:0/97368551 reap_dead start 2024-09-11T02:05:08.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 shutdown_connections 2024-09-11T02:05:08.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 >> 172.21.15.73:0/97368551 conn(0x7fab080abf50 msgr2=0x7fab081426a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:08.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 shutdown_connections 2024-09-11T02:05:08.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.405+0000 7fab0d1ec640 1 -- 172.21.15.73:0/97368551 wait complete. 2024-09-11T02:05:08.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.518+0000 7f101eb33640 10 monclient: get_monmap_and_config 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.518+0000 7f101eb33640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.518+0000 7f101eb33640 10 monclient: monmap: 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:08.519299+0000 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:08.519299+0000 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.520 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.521 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.521 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 1 Processor -- start 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 1 -- start start 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 10 monclient: init 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 10 monclient: _add_conns ranks=[5,4,1,7,3,2,0,6,8] 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 10 monclient(hunting): picked mon.noname-h con 0x7f1018138960 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 10 monclient(hunting): picked mon.noname-c con 0x7f1018139450 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 10 monclient(hunting): picked mon.noname-f con 0x7f101813f620 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101809d030 con 0x7f101813f620 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101809d310 con 0x7f1018139450 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101806f770 con 0x7f1018138960 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f101eb33640 10 monclient(hunting): authenticate will time out at 1150.123831s 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f1017fff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f1018139450 0x7f101813df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40432/0 (socket says 172.21.15.73:40432) 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.519+0000 7f1017fff640 1 -- 172.21.15.73:0/1063891244 learned_addr learned my addr 172.21.15.73:0/1063891244 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 -- 172.21.15.73:0/1063891244 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096406611 0 0) 0x7f101809d310 con 0x7f1018139450 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient(hunting): my global_id is 6511 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 -- 172.21.15.73:0/1063891244 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1008003520 con 0x7f1018139450 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 -- 172.21.15.73:0/1063891244 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3722425091 0 0) 0x7f1008003520 con 0x7f1018139450 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 -- 172.21.15.73:0/1063891244 >> v1:172.21.15.203:6791/0 conn(0x7f1018138960 legacy=0x7f1018138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 -- 172.21.15.73:0/1063891244 >> v1:172.21.15.203:6789/0 conn(0x7f101813f620 legacy=0x7f1018141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 monclient: found mon.noname-c 2024-09-11T02:05:08.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 -- 172.21.15.73:0/1063891244 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10180a7360 con 0x7f1018139450 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 5 monclient: authenticate success, global_id 6511 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 -- 172.21.15.73:0/1063891244 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1004001830 con 0x7f1018139450 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: dump: 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.531 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.532 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 -- 172.21.15.73:0/1063891244 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1004001a50 con 0x7f1018139450 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 1 -- 172.21.15.73:0/1063891244 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1004004be0 con 0x7f1018139450 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 4 set_mon_vals no callback set 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f10177fe640 10 monclient: dump: 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 10 monclient: shutdown 2024-09-11T02:05:08.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 1 -- 172.21.15.73:0/1063891244 >> v1:172.21.15.73:6791/0 conn(0x7f1018139450 legacy=0x7f101813df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 1 -- 172.21.15.73:0/1063891244 shutdown_connections 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.520+0000 7f101eb33640 1 -- 172.21.15.73:0/1063891244 >> 172.21.15.73:0/1063891244 conn(0x7f10180a8050 msgr2=0x7f10180a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.521+0000 7f101eb33640 1 -- 172.21.15.73:0/1063891244 shutdown_connections 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.521+0000 7f101eb33640 1 -- 172.21.15.73:0/1063891244 wait complete. 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.521+0000 7f101eb33640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.521+0000 7f101eb33640 10 monclient: monmap: 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:08.535 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.521+0000 7f101eb33640 1 Processor -- start 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.521+0000 7f101eb33640 1 -- start start 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.521+0000 7f101eb33640 10 monclient: init 2024-09-11T02:05:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 10 monclient: _add_conns ranks=[8,4,6,3,0,1,5,7,2] 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 10 monclient(hunting): picked mon.noname-e con 0x7f1018138960 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 10 monclient(hunting): picked mon.noname-c con 0x7f1018139450 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 10 monclient(hunting): picked mon.noname-d con 0x7f101813f620 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101813c900 con 0x7f1018139450 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101813cbe0 con 0x7f101813f620 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101806e9c0 con 0x7f1018138960 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f101eb33640 10 monclient(hunting): authenticate will time out at 1150.126527s 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f1017fff640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f1018139450 0x7f10181d2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40438/0 (socket says 172.21.15.73:40438) 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f1017fff640 1 -- 172.21.15.73:0/816528096 learned_addr learned my addr 172.21.15.73:0/816528096 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841109688 0 0) 0x7f101813c900 con 0x7f1018139450 2024-09-11T02:05:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): my global_id is 6520 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ffc003520 con 0x7f1018139450 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610475234 0 0) 0x7f101806e9c0 con 0x7f1018138960 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): my global_id is 115757 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101813c900 con 0x7f1018138960 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723856007 0 0) 0x7f101813cbe0 con 0x7f101813f620 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 10 monclient(hunting): my global_id is 115800 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.522+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101806e9c0 con 0x7f101813f620 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1748332167 0 0) 0x7f101813c900 con 0x7f1018138960 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f101813cbe0 con 0x7f1018138960 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 799714542 0 0) 0x7f101806e9c0 con 0x7f101813f620 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f101813c900 con 0x7f101813f620 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f100c001a50 con 0x7f1018138960 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): dump: 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.539 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.540 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 859570728 0 0) 0x7f0ffc003520 con 0x7f1018139450 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f101806e9c0 con 0x7f1018139450 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1010001b80 con 0x7f101813f620 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): dump: 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.541 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.542 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f1004004b20 con 0x7f1018139450 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient(hunting): dump: 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.543 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.8 v1:172.21.15.73:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3638038492 0 0) 0x7f101813cbe0 con 0x7f1018138960 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 >> v1:172.21.15.73:6792/0 conn(0x7f101813f620 legacy=0x7f10181d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 >> v1:172.21.15.73:6791/0 conn(0x7f1018139450 legacy=0x7f10181d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 monclient: found mon.e 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101813f1e0 con 0x7f1018138960 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f101eb33640 5 monclient: authenticate success, global_id 115757 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f101eb33640 10 monclient: _renew_subs 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f101eb33640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f10180a2320 con 0x7f1018138960 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f101eb33640 10 monclient: _renew_subs 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f101eb33640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f10180a4a50 con 0x7f1018138960 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.8 v1:172.21.15.73:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f100c0038c0 con 0x7f1018138960 2024-09-11T02:05:08.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.8 v1:172.21.15.73:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f100c003e30 con 0x7f1018138960 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f1016ffd640 4 set_mon_vals no callback set 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.523+0000 7f10157fa640 10 monclient: dump: 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.546 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.524+0000 7f101eb33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.524+0000 7f101eb33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.524+0000 7f101eb33640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.73:6793/0 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.524+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.8 v1:172.21.15.73:6793/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f100c003fd0 con 0x7f1018138960 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.524+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.73:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff8005080 con 0x7f1018138960 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.524+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.8 v1:172.21.15.73:6793/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f100c04d050 con 0x7f1018138960 2024-09-11T02:05:08.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.524+0000 7f1017fff640 10 monclient: get_auth_request con 0x7f0ffc040630 auth_method 0 2024-09-11T02:05:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.529+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mon.8 v1:172.21.15.73:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f100c0162d0 con 0x7f1018138960 2024-09-11T02:05:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.529+0000 7f10157fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:08.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.529+0000 7f10157fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:08.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.704+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f0ff8000b90 con 0x7f0ffc040630 2024-09-11T02:05:08.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.705+0000 7f10157fa640 1 -- 172.21.15.73:0/816528096 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f0ff8000b90 con 0x7f0ffc040630 2024-09-11T02:05:08.706 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T02:05:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.707+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 >> v1:172.21.15.203:6812/2311533528 conn(0x7f0ffc040630 legacy=0x7f0ffc042af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.707+0000 7f101eb33640 10 monclient: shutdown 2024-09-11T02:05:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.707+0000 7f101eb33640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.707+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 >> v1:172.21.15.73:6793/0 conn(0x7f1018138960 legacy=0x7f1018138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.707+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 shutdown_connections 2024-09-11T02:05:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.707+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 >> 172.21.15.73:0/816528096 conn(0x7f10180a8050 msgr2=0x7f10180a9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.707+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 shutdown_connections 2024-09-11T02:05:08.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.707+0000 7f101eb33640 1 -- 172.21.15.73:0/816528096 wait complete. 2024-09-11T02:05:08.720 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T02:05:08.720 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T02:05:08.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.820+0000 7f7204c0f640 10 monclient: get_monmap_and_config 2024-09-11T02:05:08.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.820+0000 7f7204c0f640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.820+0000 7f7204c0f640 10 monclient: monmap: 2024-09-11T02:05:08.822 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.822 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.822 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:08.821658+0000 2024-09-11T02:05:08.822 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:08.821658+0000 2024-09-11T02:05:08.822 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.823 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.821+0000 7f7204c0f640 1 Processor -- start 2024-09-11T02:05:08.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.821+0000 7f7204c0f640 1 -- start start 2024-09-11T02:05:08.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.821+0000 7f7204c0f640 10 monclient: init 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 10 monclient: _add_conns ranks=[2,5,1,6,8,4,7,0,3] 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 10 monclient(hunting): picked mon.noname-b con 0x7f72000a5e20 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 10 monclient(hunting): picked mon.noname-h con 0x7f720009dcc0 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 10 monclient(hunting): picked mon.noname-f con 0x7f72000a6910 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72000a7ce0 con 0x7f72000a6910 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f720009d2e0 con 0x7f72000a5e20 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72000a7680 con 0x7f720009dcc0 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 10 monclient(hunting): authenticate will time out at 1150.426355s 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fe59c640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f72000a5e20 0x7f72000a6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41948/0 (socket says 172.21.15.73:41948) 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fe59c640 1 -- 172.21.15.73:0/1903193214 learned_addr learned my addr 172.21.15.73:0/1903193214 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 775754228 0 0) 0x7f720009d2e0 con 0x7f72000a5e20 2024-09-11T02:05:08.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): my global_id is 135038 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e8003520 con 0x7f72000a5e20 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020147374 0 0) 0x7f72000a7680 con 0x7f720009dcc0 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): my global_id is 144320 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f720009d2e0 con 0x7f720009dcc0 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949474614 0 0) 0x7f72000a7ce0 con 0x7f72000a6910 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient(hunting): my global_id is 144244 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72000a7680 con 0x7f72000a6910 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2672268243 0 0) 0x7f71e8003520 con 0x7f72000a5e20 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 >> v1:172.21.15.203:6791/0 conn(0x7f720009dcc0 legacy=0x7f720013e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 >> v1:172.21.15.203:6789/0 conn(0x7f72000a6910 legacy=0x7f7200141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 monclient: found mon.noname-b 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:08.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720009ca00 con 0x7f72000a5e20 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f71f0001bb0 con 0x7f72000a5e20 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 5 monclient: authenticate success, global_id 135038 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f7204c0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.822+0000 7f71fdd9b640 10 monclient: dump: 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.836 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.837 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.838 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.838 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:08.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71f0001dd0 con 0x7f72000a5e20 2024-09-11T02:05:08.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f71fdd9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f71fdd9b640 1 -- 172.21.15.73:0/1903193214 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f71f0004f60 con 0x7f72000a5e20 2024-09-11T02:05:08.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:08.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 4 set_mon_vals no callback set 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f71fdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f71fdd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f71fdd9b640 10 monclient: dump: 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.839 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.840 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.840 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.840 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.840 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.840 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.840 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.840 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.840 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 10 monclient: shutdown 2024-09-11T02:05:08.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:08.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 1 -- 172.21.15.73:0/1903193214 >> v1:172.21.15.73:6790/0 conn(0x7f72000a5e20 legacy=0x7f72000a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 1 -- 172.21.15.73:0/1903193214 shutdown_connections 2024-09-11T02:05:08.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 1 -- 172.21.15.73:0/1903193214 >> 172.21.15.73:0/1903193214 conn(0x7f72000a7f20 msgr2=0x7f72000a8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:08.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 1 -- 172.21.15.73:0/1903193214 shutdown_connections 2024-09-11T02:05:08.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.823+0000 7f7204c0f640 1 -- 172.21.15.73:0/1903193214 wait complete. 2024-09-11T02:05:08.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.824+0000 7f7204c0f640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.824+0000 7f7204c0f640 10 monclient: monmap: 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.843 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.824+0000 7f7204c0f640 1 Processor -- start 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.824+0000 7f7204c0f640 1 -- start start 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.824+0000 7f7204c0f640 10 monclient: init 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 10 monclient: _add_conns ranks=[7,3,0,6,5,8,1,2,4] 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 10 monclient(hunting): picked mon.noname-i con 0x7f720009dcc0 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 10 monclient(hunting): picked mon.noname-g con 0x7f72000a5e20 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 10 monclient(hunting): picked mon.noname-a con 0x7f72000a6910 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:08.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f720006ecc0 con 0x7f72000a6910 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7200128440 con 0x7f72000a5e20 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7200126f50 con 0x7f720009dcc0 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 10 monclient(hunting): authenticate will time out at 1150.429207s 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71fed9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f72000a6910 0x7f7200126300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60496/0 (socket says 172.21.15.73:60496) 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71fed9d640 1 -- 172.21.15.73:0/756370118 learned_addr learned my addr 172.21.15.73:0/756370118 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 794040792 0 0) 0x7f720006ecc0 con 0x7f72000a6910 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): my global_id is 6813 2024-09-11T02:05:08.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e0003520 con 0x7f72000a6910 2024-09-11T02:05:08.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1342175600 0 0) 0x7f7200126f50 con 0x7f720009dcc0 2024-09-11T02:05:08.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): my global_id is 6658 2024-09-11T02:05:08.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f720006ecc0 con 0x7f720009dcc0 2024-09-11T02:05:08.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179958492 0 0) 0x7f7200128440 con 0x7f72000a5e20 2024-09-11T02:05:08.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): my global_id is 6654 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7200126f50 con 0x7f72000a5e20 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 910586655 0 0) 0x7f71e0003520 con 0x7f72000a6910 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7200128440 con 0x7f72000a6910 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f71f8001a00 con 0x7f72000a6910 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): dump: 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.847 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.848 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 493386807 0 0) 0x7f7200126f50 con 0x7f72000a5e20 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71e0003520 con 0x7f72000a5e20 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f71f4001a80 con 0x7f72000a5e20 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): dump: 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.7 v1:172.21.15.203:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1508290692 0 0) 0x7f720006ecc0 con 0x7f720009dcc0 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.203:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7200126f50 con 0x7f720009dcc0 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.7 v1:172.21.15.203:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f71f0004ea0 con 0x7f720009dcc0 2024-09-11T02:05:08.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient(hunting): dump: 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.851 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.852 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1424243217 0 0) 0x7f7200128440 con 0x7f72000a6910 2024-09-11T02:05:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 >> v1:172.21.15.203:6792/0 conn(0x7f720009dcc0 legacy=0x7f72001254e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 >> v1:172.21.15.203:6790/0 conn(0x7f72000a5e20 legacy=0x7f7200125bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 monclient: found mon.a 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72001292b0 con 0x7f72000a6910 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f71eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 5 monclient: authenticate success, global_id 6813 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 10 monclient: _renew_subs 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.825+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7200128a10 con 0x7f72000a6910 2024-09-11T02:05:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f7204c0f640 10 monclient: _renew_subs 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f7204c0f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f72001d6e60 con 0x7f72000a6910 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71f8001d00 con 0x7f72000a6910 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f71eeffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f71f8003c00 con 0x7f72000a6910 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f71eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f71eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f71fd59a640 4 set_mon_vals no callback set 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f71eeffd640 10 monclient: dump: 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.854 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f7204c0f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f71e4000f80 con 0x7f72000a6910 2024-09-11T02:05:08.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.826+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f71f8003e20 con 0x7f72000a6910 2024-09-11T02:05:08.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.827+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f71f804e170 con 0x7f72000a6910 2024-09-11T02:05:08.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.827+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.203:6800/464336651 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71e004aef0 con 0x7f71e0047280 2024-09-11T02:05:08.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.827+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=317) ==== 24+0+0 (unknown 544367114 0 0) 0x7f71f804e640 con 0x7f72000a6910 2024-09-11T02:05:08.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.827+0000 7f71eeffd640 10 monclient: handle_get_version_reply finishing 1 version 317 2024-09-11T02:05:08.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.827+0000 7f71fe59c640 10 monclient: get_auth_request con 0x7f71e00406d0 auth_method 0 2024-09-11T02:05:08.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.827+0000 7f71effff640 10 monclient: get_auth_request con 0x7f71e0047280 auth_method 0 2024-09-11T02:05:08.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.828+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== osd.5 v1:172.21.15.203:6800/464336651 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f71e004aef0 con 0x7f71e0047280 2024-09-11T02:05:08.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.840+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 --> v1:172.21.15.203:6800/464336651 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f71e4002cd0 con 0x7f71e0047280 2024-09-11T02:05:08.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.841+0000 7f71eeffd640 1 -- 172.21.15.73:0/756370118 <== osd.5 v1:172.21.15.203:6800/464336651 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f71e4002cd0 con 0x7f71e0047280 2024-09-11T02:05:08.858 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-11T02:05:08.858 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T02:05:08.858 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-11T02:05:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.841+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 >> v1:172.21.15.203:6800/464336651 conn(0x7f71e0047280 legacy=0x7f71e00496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.841+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 >> v1:172.21.15.203:6812/2311533528 conn(0x7f71e00406d0 legacy=0x7f71e0042b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.841+0000 7f7204c0f640 10 monclient: shutdown 2024-09-11T02:05:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.841+0000 7f7204c0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.841+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 >> v1:172.21.15.73:6789/0 conn(0x7f72000a6910 legacy=0x7f7200126300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.841+0000 7f71fed9d640 1 -- 172.21.15.73:0/756370118 reap_dead start 2024-09-11T02:05:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.841+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 shutdown_connections 2024-09-11T02:05:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.841+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 >> 172.21.15.73:0/756370118 conn(0x7f72000a7f20 msgr2=0x7f72001425c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.842+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 shutdown_connections 2024-09-11T02:05:08.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.842+0000 7f7204c0f640 1 -- 172.21.15.73:0/756370118 wait complete. 2024-09-11T02:05:08.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T02:05:08.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.957+0000 7fd68ab64640 10 monclient: get_monmap_and_config 2024-09-11T02:05:08.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.957+0000 7fd68ab64640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.957+0000 7fd68ab64640 10 monclient: monmap: 2024-09-11T02:05:08.959 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.959 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:08.958791+0000 2024-09-11T02:05:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:08.958791+0000 2024-09-11T02:05:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.960 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.961 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.961 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.958+0000 7fd68ab64640 1 Processor -- start 2024-09-11T02:05:08.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.958+0000 7fd68ab64640 1 -- start start 2024-09-11T02:05:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.958+0000 7fd68ab64640 10 monclient: init 2024-09-11T02:05:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 10 monclient: _add_conns ranks=[1,5,0,8,7,4,3,2,6] 2024-09-11T02:05:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 10 monclient(hunting): picked mon.noname-f con 0x7fd684138d40 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 10 monclient(hunting): picked mon.noname-h con 0x7fd6840a72f0 addr v1:172.21.15.203:6791/0 2024-09-11T02:05:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 10 monclient(hunting): picked mon.noname-a con 0x7fd68413f350 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68409ca00 con 0x7fd68413f350 2024-09-11T02:05:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6840a7070 con 0x7fd684138d40 2024-09-11T02:05:08.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 1 -- --> v1:172.21.15.203:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68409cee0 con 0x7fd6840a72f0 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 10 monclient(hunting): authenticate will time out at 1150.563319s 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd689101640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd68413f350 0x7fd684141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60502/0 (socket says 172.21.15.73:60502) 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd689101640 1 -- 172.21.15.73:0/1033163553 learned_addr learned my addr 172.21.15.73:0/1033163553 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904397860 0 0) 0x7fd68409ca00 con 0x7fd68413f350 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): my global_id is 6822 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd674003520 con 0x7fd68413f350 2024-09-11T02:05:08.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383771723 0 0) 0x7fd6840a7070 con 0x7fd684138d40 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): my global_id is 144253 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd68409ca00 con 0x7fd684138d40 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 <== mon.5 v1:172.21.15.203:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940397574 0 0) 0x7fd68409cee0 con 0x7fd6840a72f0 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient(hunting): my global_id is 144329 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 --> v1:172.21.15.203:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6840a7070 con 0x7fd6840a72f0 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3775215092 0 0) 0x7fd674003520 con 0x7fd68413f350 2024-09-11T02:05:08.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 >> v1:172.21.15.203:6791/0 conn(0x7fd6840a72f0 legacy=0x7fd68413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 >> v1:172.21.15.203:6789/0 conn(0x7fd684138d40 legacy=0x7fd684139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 monclient: found mon.noname-a 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.73:6789/0 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68409d1c0 con 0x7fd68413f350 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd67c001b50 con 0x7fd68413f350 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 5 monclient: authenticate success, global_id 6822 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient: dump: 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.978 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd67c001cf0 con 0x7fd68413f350 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd6837fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.959+0000 7fd68ab64640 4 set_mon_vals no callback set 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd6837fe640 1 -- 172.21.15.73:0/1033163553 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd67c004f60 con 0x7fd68413f350 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd6837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd6837fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd6837fe640 10 monclient: dump: 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.979 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.980 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd68ab64640 10 monclient: shutdown 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd68ab64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd68ab64640 1 -- 172.21.15.73:0/1033163553 >> v1:172.21.15.73:6789/0 conn(0x7fd68413f350 legacy=0x7fd684141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd68ab64640 1 -- 172.21.15.73:0/1033163553 shutdown_connections 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd68ab64640 1 -- 172.21.15.73:0/1033163553 >> 172.21.15.73:0/1033163553 conn(0x7fd6840a8050 msgr2=0x7fd6840a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd68ab64640 1 -- 172.21.15.73:0/1033163553 shutdown_connections 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.960+0000 7fd68ab64640 1 -- 172.21.15.73:0/1033163553 wait complete. 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.961+0000 7fd68ab64640 10 monclient: build_initial_monmap 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.961+0000 7fd68ab64640 10 monclient: monmap: 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:08.981 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.961+0000 7fd68ab64640 1 Processor -- start 2024-09-11T02:05:08.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.961+0000 7fd68ab64640 1 -- start start 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.961+0000 7fd68ab64640 10 monclient: init 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 10 monclient: _add_conns ranks=[3,2,7,1,5,4,8,0,6] 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 10 monclient(hunting): picked mon.noname-g con 0x7fd6840a72f0 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 10 monclient(hunting): picked mon.noname-b con 0x7fd684138d40 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 10 monclient(hunting): picked mon.noname-i con 0x7fd68413f350 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68413ba60 con 0x7fd684138d40 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6840a5450 con 0x7fd6840a72f0 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6840a1b00 con 0x7fd68413f350 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 10 monclient(hunting): authenticate will time out at 1150.566167s 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd683fff640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fd684138d40 0x7fd6840a0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41960/0 (socket says 172.21.15.73:41960) 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd683fff640 1 -- 172.21.15.73:0/1192738624 learned_addr learned my addr 172.21.15.73:0/1192738624 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:08.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798692438 0 0) 0x7fd68413ba60 con 0x7fd684138d40 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): my global_id is 135047 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd668003550 con 0x7fd684138d40 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.3 v1:172.21.15.203:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340286361 0 0) 0x7fd6840a5450 con 0x7fd6840a72f0 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): my global_id is 6663 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.203:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd68413ba60 con 0x7fd6840a72f0 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525460975 0 0) 0x7fd6840a1b00 con 0x7fd68413f350 2024-09-11T02:05:08.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _negotiate 2024-09-11T02:05:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): my global_id is 6667 2024-09-11T02:05:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6840a5450 con 0x7fd68413f350 2024-09-11T02:05:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 700743059 0 0) 0x7fd668003550 con 0x7fd684138d40 2024-09-11T02:05:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6840a1b00 con 0x7fd684138d40 2024-09-11T02:05:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd670001ad0 con 0x7fd684138d40 2024-09-11T02:05:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): dump: 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.986 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.3 v1:172.21.15.203:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 530611375 0 0) 0x7fd68413ba60 con 0x7fd6840a72f0 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.203:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd668003550 con 0x7fd6840a72f0 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.3 v1:172.21.15.203:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd678001a50 con 0x7fd6840a72f0 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-11T02:05:08.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient(hunting): dump: 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.988 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2782081168 0 0) 0x7fd6840a1b00 con 0x7fd684138d40 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 >> v1:172.21.15.203:6792/0 conn(0x7fd68413f350 legacy=0x7fd6840a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 >> v1:172.21.15.203:6790/0 conn(0x7fd6840a72f0 legacy=0x7fd6840a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient: _finish_hunting 0 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 monclient: found mon.b 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68413b1c0 con 0x7fd684138d40 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient: _finish_auth 0 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 10 monclient: _check_auth_tickets 2024-09-11T02:05:08.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd6817fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 5 monclient: authenticate success, global_id 135047 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 10 monclient: _renew_subs 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.962+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd68413a450 con 0x7fd684138d40 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd68ab64640 10 monclient: _renew_subs 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd68ab64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd6841d6db0 con 0x7fd684138d40 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6700038c0 con 0x7fd684138d40 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd6817fa640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fd670003df0 con 0x7fd684138d40 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd6817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd6817fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd682ffd640 4 set_mon_vals no callback set 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd6817fa640 10 monclient: dump: 2024-09-11T02:05:08.990 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:08.991 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:08.992 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:08.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.963+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fd670003f90 con 0x7fd684138d40 2024-09-11T02:05:08.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.964+0000 7fd68ab64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:08.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.964+0000 7fd68ab64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:08.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.964+0000 7fd68ab64640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:08.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.964+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd664005080 con 0x7fd684138d40 2024-09-11T02:05:08.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.964+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7fd67004e250 con 0x7fd684138d40 2024-09-11T02:05:08.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.964+0000 7fd688900640 10 monclient: get_auth_request con 0x7fd668040250 auth_method 0 2024-09-11T02:05:08.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.968+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fd6700174d0 con 0x7fd684138d40 2024-09-11T02:05:08.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.968+0000 7fd6817fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:08.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:08.968+0000 7fd6817fa640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:09.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.146+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd664000b90 con 0x7fd668040250 2024-09-11T02:05:09.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.147+0000 7fd6817fa640 1 -- 172.21.15.73:0/1192738624 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fd664000b90 con 0x7fd668040250 2024-09-11T02:05:09.149 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T02:05:09.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.149+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 >> v1:172.21.15.203:6812/2311533528 conn(0x7fd668040250 legacy=0x7fd668042710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:09.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.149+0000 7fd68ab64640 10 monclient: shutdown 2024-09-11T02:05:09.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.149+0000 7fd68ab64640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:09.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.149+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 >> v1:172.21.15.73:6790/0 conn(0x7fd684138d40 legacy=0x7fd6840a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:09.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.149+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 shutdown_connections 2024-09-11T02:05:09.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.149+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 >> 172.21.15.73:0/1192738624 conn(0x7fd6840a8050 msgr2=0x7fd6840a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:09.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.149+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 shutdown_connections 2024-09-11T02:05:09.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.149+0000 7fd68ab64640 1 -- 172.21.15.73:0/1192738624 wait complete. 2024-09-11T02:05:09.161 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T02:05:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.258+0000 7fca48802640 10 monclient: get_monmap_and_config 2024-09-11T02:05:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.258+0000 7fca48802640 10 monclient: build_initial_monmap 2024-09-11T02:05:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.258+0000 7fca48802640 10 monclient: monmap: 2024-09-11T02:05:09.260 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:09.259574+0000 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:09.259574+0000 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:09.261 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:09.262 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:09.262 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:09.262 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:09.262 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:09.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.259+0000 7fca48802640 1 Processor -- start 2024-09-11T02:05:09.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.259+0000 7fca48802640 1 -- start start 2024-09-11T02:05:09.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.259+0000 7fca48802640 10 monclient: init 2024-09-11T02:05:09.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.259+0000 7fca48802640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:09.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.259+0000 7fca48802640 10 monclient: _add_conns ranks=[2,3,4,0,8,6,7,5,1] 2024-09-11T02:05:09.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.259+0000 7fca48802640 10 monclient(hunting): picked mon.noname-b con 0x7fca440a3750 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:09.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 10 monclient(hunting): picked mon.noname-g con 0x7fca4409cfc0 addr v1:172.21.15.203:6790/0 2024-09-11T02:05:09.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 10 monclient(hunting): picked mon.noname-c con 0x7fca440a4240 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:09.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4409ed80 con 0x7fca440a3750 2024-09-11T02:05:09.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 1 -- --> v1:172.21.15.203:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4409e4e0 con 0x7fca4409cfc0 2024-09-11T02:05:09.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca440a52b0 con 0x7fca440a4240 2024-09-11T02:05:09.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:09.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 10 monclient(hunting): authenticate will time out at 1150.864045s 2024-09-11T02:05:09.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca4359e640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7fca440a4240 0x7fca4413e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:40452/0 (socket says 172.21.15.73:40452) 2024-09-11T02:05:09.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca42d9d640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fca440a3750 0x7fca440a3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41974/0 (socket says 172.21.15.73:41974) 2024-09-11T02:05:09.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca4359e640 1 -- 172.21.15.73:0/1489894506 learned_addr learned my addr 172.21.15.73:0/1489894506 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:09.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402590341 0 0) 0x7fca4409ed80 con 0x7fca440a3750 2024-09-11T02:05:09.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:09.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:09.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:09.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient(hunting): my global_id is 135056 2024-09-11T02:05:09.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca30003520 con 0x7fca440a3750 2024-09-11T02:05:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459001259 0 0) 0x7fca440a52b0 con 0x7fca440a4240 2024-09-11T02:05:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient(hunting): _negotiate 2024-09-11T02:05:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient(hunting): my global_id is 6529 2024-09-11T02:05:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca4409ed80 con 0x7fca440a4240 2024-09-11T02:05:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2022194203 0 0) 0x7fca30003520 con 0x7fca440a3750 2024-09-11T02:05:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 >> v1:172.21.15.73:6791/0 conn(0x7fca440a4240 legacy=0x7fca4413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 >> v1:172.21.15.203:6790/0 conn(0x7fca4409cfc0 legacy=0x7fca4413a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: _finish_hunting 0 2024-09-11T02:05:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 monclient: found mon.noname-b 2024-09-11T02:05:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.73:6790/0 2024-09-11T02:05:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4409d440 con 0x7fca440a3750 2024-09-11T02:05:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: _finish_auth 0 2024-09-11T02:05:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: _check_auth_tickets 2024-09-11T02:05:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fca34001bb0 con 0x7fca440a3750 2024-09-11T02:05:09.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 5 monclient: authenticate success, global_id 135056 2024-09-11T02:05:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: dump: 2024-09-11T02:05:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:09.279 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:09.281 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca34001dd0 con 0x7fca440a3750 2024-09-11T02:05:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 1 -- 172.21.15.73:0/1489894506 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fca34004ea0 con 0x7fca440a3750 2024-09-11T02:05:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca48802640 4 set_mon_vals no callback set 2024-09-11T02:05:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:09.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.260+0000 7fca41d9b640 10 monclient: dump: 2024-09-11T02:05:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:09.284 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:09.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.261+0000 7fca48802640 10 monclient: shutdown 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.261+0000 7fca48802640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.261+0000 7fca48802640 1 -- 172.21.15.73:0/1489894506 >> v1:172.21.15.73:6790/0 conn(0x7fca440a3750 legacy=0x7fca440a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.261+0000 7fca48802640 1 -- 172.21.15.73:0/1489894506 shutdown_connections 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.261+0000 7fca48802640 1 -- 172.21.15.73:0/1489894506 >> 172.21.15.73:0/1489894506 conn(0x7fca440a8370 msgr2=0x7fca440a4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.261+0000 7fca48802640 1 -- 172.21.15.73:0/1489894506 shutdown_connections 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.261+0000 7fca48802640 1 -- 172.21.15.73:0/1489894506 wait complete. 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.261+0000 7fca48802640 10 monclient: build_initial_monmap 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.261+0000 7fca48802640 10 monclient: monmap: 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:09.285 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:09.286 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:09.286 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:09.286 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:09.286 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:09.286 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:09.286 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:09.286 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.262+0000 7fca48802640 1 Processor -- start 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.262+0000 7fca48802640 1 -- start start 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.262+0000 7fca48802640 10 monclient: init 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.262+0000 7fca48802640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.262+0000 7fca48802640 10 monclient: _add_conns ranks=[6,2,1,8,0,7,3,5,4] 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.262+0000 7fca48802640 10 monclient(hunting): picked mon.noname-d con 0x7fca4409cfc0 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.262+0000 7fca48802640 10 monclient(hunting): picked mon.noname-b con 0x7fca440a3750 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:09.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.262+0000 7fca48802640 10 monclient(hunting): picked mon.noname-f con 0x7fca440a4240 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.262+0000 7fca48802640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca44128980 con 0x7fca440a4240 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca44128c60 con 0x7fca440a3750 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca440a13c0 con 0x7fca4409cfc0 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 10 monclient(hunting): authenticate will time out at 1150.867044s 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca4259c640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fca440a3750 0x7fca44122640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41978/0 (socket says 172.21.15.73:41978) 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca4259c640 1 -- 172.21.15.73:0/4195114925 learned_addr learned my addr 172.21.15.73:0/4195114925 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648816942 0 0) 0x7fca44128c60 con 0x7fca440a3750 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): my global_id is 135065 2024-09-11T02:05:09.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca24003520 con 0x7fca440a3750 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134262152 0 0) 0x7fca440a13c0 con 0x7fca4409cfc0 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): my global_id is 115809 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca44128c60 con 0x7fca4409cfc0 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2048418686 0 0) 0x7fca24003520 con 0x7fca440a3750 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca440a13c0 con 0x7fca440a3750 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fca2c001b50 con 0x7fca440a3750 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:09.289 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:09.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838146640 0 0) 0x7fca44128980 con 0x7fca440a4240 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): my global_id is 144262 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca24003520 con 0x7fca440a4240 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 469707578 0 0) 0x7fca44128c60 con 0x7fca4409cfc0 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca44128980 con 0x7fca4409cfc0 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fca34001b70 con 0x7fca4409cfc0 2024-09-11T02:05:09.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient(hunting): dump: 2024-09-11T02:05:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2562441664 0 0) 0x7fca440a13c0 con 0x7fca440a3750 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 >> v1:172.21.15.73:6792/0 conn(0x7fca4409cfc0 legacy=0x7fca44121f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:09.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 >> v1:172.21.15.203:6789/0 conn(0x7fca440a4240 legacy=0x7fca441d5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 monclient: found mon.b 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca440a32e0 con 0x7fca440a3750 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 5 monclient: authenticate success, global_id 135065 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 10 monclient: _renew_subs 2024-09-11T02:05:09.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fca441286a0 con 0x7fca440a3750 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 10 monclient: _renew_subs 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fca44122d50 con 0x7fca440a3750 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca2c0038c0 con 0x7fca440a3750 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7fca2c003df0 con 0x7fca440a3750 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca4159a640 4 set_mon_vals no callback set 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.263+0000 7fca3b7fe640 10 monclient: dump: 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:09.295 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:09.297 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.264+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7fca2c003f90 con 0x7fca440a3750 2024-09-11T02:05:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.264+0000 7fca48802640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.264+0000 7fca48802640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.264+0000 7fca48802640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.264+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca28005080 con 0x7fca440a3750 2024-09-11T02:05:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.264+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7fca2c04e340 con 0x7fca440a3750 2024-09-11T02:05:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.265+0000 7fca42d9d640 10 monclient: get_auth_request con 0x7fca240405c0 auth_method 0 2024-09-11T02:05:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.269+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7fca2c0175e0 con 0x7fca440a3750 2024-09-11T02:05:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.269+0000 7fca3b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.269+0000 7fca3b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:09.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.440+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca28000b90 con 0x7fca240405c0 2024-09-11T02:05:09.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.441+0000 7fca3b7fe640 1 -- 172.21.15.73:0/4195114925 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34024 (unknown 2965378022 0 1535554606) 0x7fca28000b90 con 0x7fca240405c0 2024-09-11T02:05:09.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T02:05:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-11T02:05:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.443+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 >> v1:172.21.15.203:6812/2311533528 conn(0x7fca240405c0 legacy=0x7fca24042a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.443+0000 7fca48802640 10 monclient: shutdown 2024-09-11T02:05:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.443+0000 7fca48802640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.443+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 >> v1:172.21.15.73:6790/0 conn(0x7fca440a3750 legacy=0x7fca44122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.444+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 shutdown_connections 2024-09-11T02:05:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.444+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 >> 172.21.15.73:0/4195114925 conn(0x7fca440a8370 msgr2=0x7fca440a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.444+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 shutdown_connections 2024-09-11T02:05:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:09.444+0000 7fca48802640 1 -- 172.21.15.73:0/4195114925 wait complete. 2024-09-11T02:05:09.456 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":518,"stamp":"2024-09-11T02:05:08.963042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":190280,"kb_used_data":7312,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566040760,"statfs":{"total":579820584960,"available":579625738240,"internally_reserved":0,"allocated":7487488,"data_stored":3759142,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9567,"internal_metadata":187226785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.315217"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":609,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625592+0000","last_change":"2024-09-11T01:58:28.988312+0000","last_active":"2024-09-11T02:05:02.625592+0000","last_peered":"2024-09-11T02:05:02.625592+0000","last_clean":"2024-09-11T02:05:02.625592+0000","last_became_active":"2024-09-11T01:58:27.047814+0000","last_became_peered":"2024-09-11T01:58:27.047814+0000","last_unstale":"2024-09-11T02:05:02.625592+0000","last_undegraded":"2024-09-11T02:05:02.625592+0000","last_fullsized":"2024-09-11T02:05:02.625592+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:11:15.861207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040037900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":602,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:04.079659+0000","last_change":"2024-09-11T01:58:28.994589+0000","last_active":"2024-09-11T02:05:04.079659+0000","last_peered":"2024-09-11T02:05:04.079659+0000","last_clean":"2024-09-11T02:05:04.079659+0000","last_became_active":"2024-09-11T01:58:26.989307+0000","last_became_peered":"2024-09-11T01:58:26.989307+0000","last_unstale":"2024-09-11T02:05:04.079659+0000","last_undegraded":"2024-09-11T02:05:04.079659+0000","last_fullsized":"2024-09-11T02:05:04.079659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:05.162449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001059894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":609,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625690+0000","last_change":"2024-09-11T01:58:28.988266+0000","last_active":"2024-09-11T02:05:02.625690+0000","last_peered":"2024-09-11T02:05:02.625690+0000","last_clean":"2024-09-11T02:05:02.625690+0000","last_became_active":"2024-09-11T01:58:26.991911+0000","last_became_peered":"2024-09-11T01:58:26.991911+0000","last_unstale":"2024-09-11T02:05:02.625690+0000","last_undegraded":"2024-09-11T02:05:02.625690+0000","last_fullsized":"2024-09-11T02:05:02.625690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:15:11.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051120699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":602,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:04.079697+0000","last_change":"2024-09-11T01:58:28.994578+0000","last_active":"2024-09-11T02:05:04.079697+0000","last_peered":"2024-09-11T02:05:04.079697+0000","last_clean":"2024-09-11T02:05:04.079697+0000","last_became_active":"2024-09-11T01:58:26.989353+0000","last_became_peered":"2024-09-11T01:58:26.989353+0000","last_unstale":"2024-09-11T02:05:04.079697+0000","last_undegraded":"2024-09-11T02:05:04.079697+0000","last_fullsized":"2024-09-11T02:05:04.079697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:06:37.795438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010300419999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":609,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625896+0000","last_change":"2024-09-11T01:58:28.992277+0000","last_active":"2024-09-11T02:05:02.625896+0000","last_peered":"2024-09-11T02:05:02.625896+0000","last_clean":"2024-09-11T02:05:02.625896+0000","last_became_active":"2024-09-11T01:58:26.992547+0000","last_became_peered":"2024-09-11T01:58:26.992547+0000","last_unstale":"2024-09-11T02:05:02.625896+0000","last_undegraded":"2024-09-11T02:05:02.625896+0000","last_fullsized":"2024-09-11T02:05:02.625896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:57:48.184504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010707749999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":612,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.624020+0000","last_change":"2024-09-11T01:58:28.988691+0000","last_active":"2024-09-11T02:05:02.624020+0000","last_peered":"2024-09-11T02:05:02.624020+0000","last_clean":"2024-09-11T02:05:02.624020+0000","last_became_active":"2024-09-11T01:58:26.989539+0000","last_became_peered":"2024-09-11T01:58:26.989539+0000","last_unstale":"2024-09-11T02:05:02.624020+0000","last_undegraded":"2024-09-11T02:05:02.624020+0000","last_fullsized":"2024-09-11T02:05:02.624020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:05.294029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063444800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":609,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625573+0000","last_change":"2024-09-11T01:58:28.988518+0000","last_active":"2024-09-11T02:05:02.625573+0000","last_peered":"2024-09-11T02:05:02.625573+0000","last_clean":"2024-09-11T02:05:02.625573+0000","last_became_active":"2024-09-11T01:58:26.992110+0000","last_became_peered":"2024-09-11T01:58:26.992110+0000","last_unstale":"2024-09-11T02:05:02.625573+0000","last_undegraded":"2024-09-11T02:05:02.625573+0000","last_fullsized":"2024-09-11T02:05:02.625573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:47.916474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058377799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":608,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625897+0000","last_change":"2024-09-11T01:58:28.991608+0000","last_active":"2024-09-11T02:05:02.625897+0000","last_peered":"2024-09-11T02:05:02.625897+0000","last_clean":"2024-09-11T02:05:02.625897+0000","last_became_active":"2024-09-11T01:58:26.992862+0000","last_became_peered":"2024-09-11T01:58:26.992862+0000","last_unstale":"2024-09-11T02:05:02.625897+0000","last_undegraded":"2024-09-11T02:05:02.625897+0000","last_fullsized":"2024-09-11T02:05:02.625897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:25.971635+0000","last_clean_scrub_stamp":"2024-09-11T01:58:25.971635+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:26:02.837285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038950200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":700,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:02.625688+0000","last_change":"2024-09-11T01:58:22.348806+0000","last_active":"2024-09-11T02:05:02.625688+0000","last_peered":"2024-09-11T02:05:02.625688+0000","last_clean":"2024-09-11T02:05:02.625688+0000","last_became_active":"2024-09-11T01:58:22.347800+0000","last_became_peered":"2024-09-11T01:58:22.347800+0000","last_unstale":"2024-09-11T02:05:02.625688+0000","last_undegraded":"2024-09-11T02:05:02.625688+0000","last_fullsized":"2024-09-11T02:05:02.625688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:58:20.928503+0000","last_clean_scrub_stamp":"2024-09-11T01:58:20.928503+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:32:37.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1232896,"data_stored":450227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1228800,"data_stored":450208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574932,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1228800,"data_stored":450208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":979136,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607636,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1282048,"data_stored":979136,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640340,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44872,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326968,"statfs":{"total":96636764160,"available":96590815232,"internally_reserved":0,"allocated":1232896,"data_stored":450227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T02:05:09.460 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T01:58:25.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=58, tm_sec=25, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=2, tm_min=5, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T02:05:09.460 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T01:58:25.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=58, tm_sec=25, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=2, tm_min=5, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T02:05:09.460 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T01:58:25.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=58, tm_sec=25, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=2, tm_min=5, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T02:05:09.460 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T01:58:25.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=58, tm_sec=25, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=2, tm_min=5, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T02:05:09.460 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T01:58:25.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=58, tm_sec=25, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=2, tm_min=5, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T02:05:09.460 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T01:58:25.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=58, tm_sec=25, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=2, tm_min=5, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T02:05:09.461 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T01:58:25.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=58, tm_sec=25, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=2, tm_min=5, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T02:05:09.461 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T01:58:25.971635+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=58, tm_sec=25, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=2, tm_min=5, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T02:05:09.461 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T01:58:20.928503+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=1, tm_min=58, tm_sec=20, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=2, tm_min=5, tm_sec=5, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T02:05:09.461 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T02:05:29.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T02:05:29.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.570+0000 7f0ca88c6640 10 monclient: get_monmap_and_config 2024-09-11T02:05:29.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.570+0000 7f0ca88c6640 10 monclient: build_initial_monmap 2024-09-11T02:05:29.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.570+0000 7f0ca88c6640 10 monclient: monmap: 2024-09-11T02:05:29.573 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:29.573 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.573 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:29.571393+0000 2024-09-11T02:05:29.573 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:29.571393+0000 2024-09-11T02:05:29.573 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:29.573 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.573 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:29.573 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 1 Processor -- start 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 1 -- start start 2024-09-11T02:05:29.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 10 monclient: init 2024-09-11T02:05:29.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:29.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 10 monclient: _add_conns ranks=[4,7,6,2,8,3,0,5,1] 2024-09-11T02:05:29.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 10 monclient(hunting): picked mon.noname-c con 0x7f0ca4138e40 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:29.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 10 monclient(hunting): picked mon.noname-i con 0x7f0ca4139220 addr v1:172.21.15.203:6792/0 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 10 monclient(hunting): picked mon.noname-d con 0x7f0ca413f250 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca409d190 con 0x7f0ca4138e40 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca409e280 con 0x7f0ca413f250 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 1 -- --> v1:172.21.15.203:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca409ceb0 con 0x7f0ca4139220 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.571+0000 7f0ca88c6640 10 monclient(hunting): authenticate will time out at 1171.175883s 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca259c640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f0ca4138e40 0x7f0ca409db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:39218/0 (socket says 172.21.15.73:39218) 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca2d9d640 1 --1- >> v1:172.21.15.73:6792/0 conn(0x7f0ca413f250 0x7f0ca4141640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6792/0 says I am v1:172.21.15.73:41796/0 (socket says 172.21.15.73:41796) 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca259c640 1 -- 172.21.15.73:0/2303874025 learned_addr learned my addr 172.21.15.73:0/2303874025 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967741538 0 0) 0x7f0ca409e280 con 0x7f0ca413f250 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): my global_id is 115818 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c8c003520 con 0x7f0ca413f250 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006560352 0 0) 0x7f0c94001110 con 0x7f0ca4138e40 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): my global_id is 6538 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ca409e280 con 0x7f0ca4138e40 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 <== mon.7 v1:172.21.15.203:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4145616345 0 0) 0x7f0ca409ceb0 con 0x7f0ca4139220 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient(hunting): my global_id is 6676 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 --> v1:172.21.15.203:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c94001110 con 0x7f0ca4139220 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3876398870 0 0) 0x7f0c8c003520 con 0x7f0ca413f250 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 >> v1:172.21.15.203:6792/0 conn(0x7f0ca4139220 legacy=0x7f0ca413db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 >> v1:172.21.15.73:6791/0 conn(0x7f0ca4138e40 legacy=0x7f0ca409db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: _finish_hunting 0 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 monclient: found mon.noname-d 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.73:6792/0 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 --> v1:172.21.15.73:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca409d470 con 0x7f0ca413f250 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: _finish_auth 0 2024-09-11T02:05:29.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: _check_auth_tickets 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca88c6640 5 monclient: authenticate success, global_id 115818 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0c9c001bb0 con 0x7f0ca413f250 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca88c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: dump: 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.589 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca88c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:29.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 <== mon.6 v1:172.21.15.73:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c9c001dd0 con 0x7f0ca413f250 2024-09-11T02:05:29.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:29.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 1 -- 172.21.15.73:0/2303874025 <== mon.6 v1:172.21.15.73:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0c9c004ea0 con 0x7f0ca413f250 2024-09-11T02:05:29.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca88c6640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:29.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca88c6640 4 set_mon_vals no callback set 2024-09-11T02:05:29.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:29.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:29.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.572+0000 7f0ca159a640 10 monclient: dump: 2024-09-11T02:05:29.592 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.592 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.592 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.592 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.593 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.593 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.593 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.593 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.593 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.593 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.594 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.594 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.594 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.594 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.594 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.594 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.573+0000 7f0ca88c6640 10 monclient: shutdown 2024-09-11T02:05:29.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.573+0000 7f0ca88c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:29.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.573+0000 7f0ca88c6640 1 -- 172.21.15.73:0/2303874025 >> v1:172.21.15.73:6792/0 conn(0x7f0ca413f250 legacy=0x7f0ca4141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.573+0000 7f0ca88c6640 1 -- 172.21.15.73:0/2303874025 shutdown_connections 2024-09-11T02:05:29.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.573+0000 7f0ca88c6640 1 -- 172.21.15.73:0/2303874025 >> 172.21.15.73:0/2303874025 conn(0x7f0ca40abe10 msgr2=0x7f0ca40a7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.573+0000 7f0ca88c6640 1 -- 172.21.15.73:0/2303874025 shutdown_connections 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.573+0000 7f0ca88c6640 1 -- 172.21.15.73:0/2303874025 wait complete. 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient: build_initial_monmap 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient: monmap: 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:29.596 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 1 Processor -- start 2024-09-11T02:05:29.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 1 -- start start 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient: init 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient: _add_conns ranks=[8,2,0,6,3,5,1,4,7] 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient(hunting): picked mon.noname-e con 0x7f0ca4138e40 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient(hunting): picked mon.noname-b con 0x7f0ca4139220 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient(hunting): picked mon.noname-a con 0x7f0ca413f250 addr v1:172.21.15.73:6789/0 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca413dba0 con 0x7f0ca413f250 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca413ab70 con 0x7f0ca4139220 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca413ae50 con 0x7f0ca4138e40 2024-09-11T02:05:29.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:29.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca88c6640 10 monclient(hunting): authenticate will time out at 1171.178910s 2024-09-11T02:05:29.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca259c640 1 --1- >> v1:172.21.15.73:6793/0 conn(0x7f0ca4138e40 0x7f0ca4140210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:46424/0 (socket says 172.21.15.73:46424) 2024-09-11T02:05:29.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.574+0000 7f0ca259c640 1 -- 172.21.15.73:0/3110203712 learned_addr learned my addr 172.21.15.73:0/3110203712 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:29.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3717828541 0 0) 0x7f0ca413ab70 con 0x7f0ca4139220 2024-09-11T02:05:29.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): my global_id is 135074 2024-09-11T02:05:29.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c84003520 con 0x7f0ca4139220 2024-09-11T02:05:29.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301034066 0 0) 0x7f0ca413ae50 con 0x7f0ca4138e40 2024-09-11T02:05:29.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): my global_id is 115766 2024-09-11T02:05:29.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ca413ab70 con 0x7f0ca4138e40 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344118910 0 0) 0x7f0ca413dba0 con 0x7f0ca413f250 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): my global_id is 6831 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ca413ae50 con 0x7f0ca413f250 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1293109905 0 0) 0x7f0c84003520 con 0x7f0ca4139220 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ca413dba0 con 0x7f0ca4139220 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 430037769 0 0) 0x7f0ca413ab70 con 0x7f0ca4138e40 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c84003520 con 0x7f0ca4138e40 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0c98001a90 con 0x7f0ca4139220 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-11T02:05:29.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.602 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 905305408 0 0) 0x7f0ca413ae50 con 0x7f0ca413f250 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ca413ab70 con 0x7f0ca413f250 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0c94001a00 con 0x7f0ca4138e40 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.603 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0c9c001380 con 0x7f0ca413f250 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:29.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient(hunting): dump: 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.605 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 986761905 0 0) 0x7f0ca413dba0 con 0x7f0ca4139220 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 >> v1:172.21.15.73:6793/0 conn(0x7f0ca4138e40 legacy=0x7f0ca4140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 >> v1:172.21.15.73:6789/0 conn(0x7f0ca413f250 legacy=0x7f0ca41d5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient: _finish_hunting 0 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 monclient: found mon.b 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca40a9a00 con 0x7f0ca4139220 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient: _finish_auth 0 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient: _check_auth_tickets 2024-09-11T02:05:29.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0ca88c6640 5 monclient: authenticate success, global_id 135074 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0ca88c6640 10 monclient: _renew_subs 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0ca88c6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca413a890 con 0x7f0ca4139220 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0ca88c6640 10 monclient: _renew_subs 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c980038c0 con 0x7f0ca4139220 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0ca88c6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ca4141210 con 0x7f0ca4139220 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f0c98001c30 con 0x7f0ca4139220 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:29.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0c92ffd640 10 monclient: dump: 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.608 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.575+0000 7f0ca0d99640 4 set_mon_vals no callback set 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.577+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f0c980103d0 con 0x7f0ca4139220 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.577+0000 7f0ca88c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.577+0000 7f0ca88c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.577+0000 7f0ca88c6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.73:6790/0 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.577+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca4142ce0 con 0x7f0ca4139220 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.577+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f0c9804d0f0 con 0x7f0ca4139220 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.577+0000 7f0ca259c640 10 monclient: get_auth_request con 0x7f0c84040640 auth_method 0 2024-09-11T02:05:29.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.581+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f0c98016430 con 0x7f0ca4139220 2024-09-11T02:05:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.581+0000 7f0c92ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:29.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.581+0000 7f0c92ffd640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.758+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 --> v1:172.21.15.203:6812/2311533528 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ca40a9590 con 0x7f0c84040640 2024-09-11T02:05:29.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.759+0000 7f0c92ffd640 1 -- 172.21.15.73:0/3110203712 <== mgr.4105 v1:172.21.15.203:6812/2311533528 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34017 (unknown 2965378022 0 3705806437) 0x7f0ca40a9590 con 0x7f0c84040640 2024-09-11T02:05:29.761 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-11T02:05:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-11T02:05:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.762+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 >> v1:172.21.15.203:6812/2311533528 conn(0x7f0c84040640 legacy=0x7f0c84042b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.762+0000 7f0ca88c6640 10 monclient: shutdown 2024-09-11T02:05:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.762+0000 7f0ca88c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.762+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 >> v1:172.21.15.73:6790/0 conn(0x7f0ca4139220 legacy=0x7f0ca4140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.762+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 shutdown_connections 2024-09-11T02:05:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.762+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 >> 172.21.15.73:0/3110203712 conn(0x7f0ca40abe10 msgr2=0x7f0ca4137070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.762+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 shutdown_connections 2024-09-11T02:05:29.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.762+0000 7f0ca88c6640 1 -- 172.21.15.73:0/3110203712 wait complete. 2024-09-11T02:05:29.774 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2024-09-11T02:05:28.967463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":190260,"kb_used_data":7312,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566040780,"statfs":{"total":579820584960,"available":579625758720,"internally_reserved":0,"allocated":7487488,"data_stored":3759142,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9567,"internal_metadata":187226785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002657"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":617,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:10.014177+0000","last_change":"2024-09-11T02:05:10.014177+0000","last_active":"2024-09-11T02:05:10.014177+0000","last_peered":"2024-09-11T02:05:10.014177+0000","last_clean":"2024-09-11T02:05:10.014177+0000","last_became_active":"2024-09-11T01:58:27.047814+0000","last_became_peered":"2024-09-11T01:58:27.047814+0000","last_unstale":"2024-09-11T02:05:10.014177+0000","last_undegraded":"2024-09-11T02:05:10.014177+0000","last_fullsized":"2024-09-11T02:05:10.014177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T02:05:10.014108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T02:05:10.014108+0000","last_clean_scrub_stamp":"2024-09-11T02:05:10.014108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:02:39.490091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040037900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":610,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:09.197546+0000","last_change":"2024-09-11T02:05:09.197546+0000","last_active":"2024-09-11T02:05:09.197546+0000","last_peered":"2024-09-11T02:05:09.197546+0000","last_clean":"2024-09-11T02:05:09.197546+0000","last_became_active":"2024-09-11T01:58:26.989307+0000","last_became_peered":"2024-09-11T01:58:26.989307+0000","last_unstale":"2024-09-11T02:05:09.197546+0000","last_undegraded":"2024-09-11T02:05:09.197546+0000","last_fullsized":"2024-09-11T02:05:09.197546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T02:05:09.197455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T02:05:09.197455+0000","last_clean_scrub_stamp":"2024-09-11T02:05:09.197455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:57:54.580726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001059894,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":617,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:10.965519+0000","last_change":"2024-09-11T02:05:10.965519+0000","last_active":"2024-09-11T02:05:10.965519+0000","last_peered":"2024-09-11T02:05:10.965519+0000","last_clean":"2024-09-11T02:05:10.965519+0000","last_became_active":"2024-09-11T01:58:26.991911+0000","last_became_peered":"2024-09-11T01:58:26.991911+0000","last_unstale":"2024-09-11T02:05:10.965519+0000","last_undegraded":"2024-09-11T02:05:10.965519+0000","last_fullsized":"2024-09-11T02:05:10.965519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T02:05:10.965420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T02:05:10.965420+0000","last_clean_scrub_stamp":"2024-09-11T02:05:10.965420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:13:11.795837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051120699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":610,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:08.177758+0000","last_change":"2024-09-11T02:05:08.177758+0000","last_active":"2024-09-11T02:05:08.177758+0000","last_peered":"2024-09-11T02:05:08.177758+0000","last_clean":"2024-09-11T02:05:08.177758+0000","last_became_active":"2024-09-11T01:58:26.989353+0000","last_became_peered":"2024-09-11T01:58:26.989353+0000","last_unstale":"2024-09-11T02:05:08.177758+0000","last_undegraded":"2024-09-11T02:05:08.177758+0000","last_fullsized":"2024-09-11T02:05:08.177758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T02:05:08.177699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T02:05:08.177699+0000","last_clean_scrub_stamp":"2024-09-11T02:05:08.177699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:46:18.527541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010300419999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"317'3","reported_seq":618,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:09.793901+0000","last_change":"2024-09-11T02:05:09.793901+0000","last_active":"2024-09-11T02:05:09.793901+0000","last_peered":"2024-09-11T02:05:09.793901+0000","last_clean":"2024-09-11T02:05:09.793901+0000","last_became_active":"2024-09-11T01:58:26.992547+0000","last_became_peered":"2024-09-11T01:58:26.992547+0000","last_unstale":"2024-09-11T02:05:09.793901+0000","last_undegraded":"2024-09-11T02:05:09.793901+0000","last_fullsized":"2024-09-11T02:05:09.793901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"317'3","last_scrub_stamp":"2024-09-11T02:05:09.793831+0000","last_deep_scrub":"317'3","last_deep_scrub_stamp":"2024-09-11T02:05:09.793831+0000","last_clean_scrub_stamp":"2024-09-11T02:05:09.793831+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:14.060395+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0010707749999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":620,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:08.175966+0000","last_change":"2024-09-11T02:05:08.175966+0000","last_active":"2024-09-11T02:05:08.175966+0000","last_peered":"2024-09-11T02:05:08.175966+0000","last_clean":"2024-09-11T02:05:08.175966+0000","last_became_active":"2024-09-11T01:58:26.989539+0000","last_became_peered":"2024-09-11T01:58:26.989539+0000","last_unstale":"2024-09-11T02:05:08.175966+0000","last_undegraded":"2024-09-11T02:05:08.175966+0000","last_fullsized":"2024-09-11T02:05:08.175966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T02:05:08.175878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T02:05:08.175878+0000","last_clean_scrub_stamp":"2024-09-11T02:05:08.175878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:40:39.105917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063444800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":617,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:11.987353+0000","last_change":"2024-09-11T02:05:11.987353+0000","last_active":"2024-09-11T02:05:11.987353+0000","last_peered":"2024-09-11T02:05:11.987353+0000","last_clean":"2024-09-11T02:05:11.987353+0000","last_became_active":"2024-09-11T01:58:26.992110+0000","last_became_peered":"2024-09-11T01:58:26.992110+0000","last_unstale":"2024-09-11T02:05:11.987353+0000","last_undegraded":"2024-09-11T02:05:11.987353+0000","last_fullsized":"2024-09-11T02:05:11.987353+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T02:05:11.987273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T02:05:11.987273+0000","last_clean_scrub_stamp":"2024-09-11T02:05:11.987273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:42.825276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058377799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"317'2","reported_seq":617,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:10.768935+0000","last_change":"2024-09-11T02:05:10.768935+0000","last_active":"2024-09-11T02:05:10.768935+0000","last_peered":"2024-09-11T02:05:10.768935+0000","last_clean":"2024-09-11T02:05:10.768935+0000","last_became_active":"2024-09-11T01:58:26.992862+0000","last_became_peered":"2024-09-11T01:58:26.992862+0000","last_unstale":"2024-09-11T02:05:10.768935+0000","last_undegraded":"2024-09-11T02:05:10.768935+0000","last_fullsized":"2024-09-11T02:05:10.768935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"317'2","last_scrub_stamp":"2024-09-11T02:05:10.768839+0000","last_deep_scrub":"317'2","last_deep_scrub_stamp":"2024-09-11T02:05:10.768839+0000","last_clean_scrub_stamp":"2024-09-11T02:05:10.768839+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:14.372388+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00038950200000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"317'74","reported_seq":710,"reported_epoch":317,"state":"active+clean","last_fresh":"2024-09-11T02:05:09.048210+0000","last_change":"2024-09-11T02:05:09.048210+0000","last_active":"2024-09-11T02:05:09.048210+0000","last_peered":"2024-09-11T02:05:09.048210+0000","last_clean":"2024-09-11T02:05:09.048210+0000","last_became_active":"2024-09-11T01:58:22.347800+0000","last_became_peered":"2024-09-11T01:58:22.347800+0000","last_unstale":"2024-09-11T02:05:09.048210+0000","last_undegraded":"2024-09-11T02:05:09.048210+0000","last_fullsized":"2024-09-11T02:05:09.048210+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"317'74","last_scrub_stamp":"2024-09-11T02:05:09.048127+0000","last_deep_scrub":"317'74","last_deep_scrub_stamp":"2024-09-11T02:05:09.048127+0000","last_clean_scrub_stamp":"2024-09-11T02:05:09.048127+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:41.458504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":11022,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1232896,"data_stored":450227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574939,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1228800,"data_stored":450208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574936,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1228800,"data_stored":450208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574936,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1282048,"data_stored":979136,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":12,"seq":51539607640,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28276,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343564,"statfs":{"total":96636764160,"available":96607809536,"internally_reserved":0,"allocated":1282048,"data_stored":979136,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640344,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44868,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326972,"statfs":{"total":96636764160,"available":96590819328,"internally_reserved":0,"allocated":1232896,"data_stored":450227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":5511,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T02:05:29.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T02:05:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.871+0000 7f712567f640 10 monclient: get_monmap_and_config 2024-09-11T02:05:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.871+0000 7f712567f640 10 monclient: build_initial_monmap 2024-09-11T02:05:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.872+0000 7f712567f640 10 monclient: monmap: 2024-09-11T02:05:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T02:05:29.872863+0000 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T02:05:29.872863+0000 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:29.874 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.872+0000 7f712567f640 1 Processor -- start 2024-09-11T02:05:29.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.872+0000 7f712567f640 1 -- start start 2024-09-11T02:05:29.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.872+0000 7f712567f640 10 monclient: init 2024-09-11T02:05:29.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 10 monclient: _add_conns ranks=[1,2,4,0,3,5,6,8,7] 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 10 monclient(hunting): picked mon.noname-f con 0x7f7120138d40 addr v1:172.21.15.203:6789/0 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 10 monclient(hunting): picked mon.noname-b con 0x7f71200a72f0 addr v1:172.21.15.73:6790/0 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 10 monclient(hunting): picked mon.noname-c con 0x7f712013f350 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f712009ca00 con 0x7f7120138d40 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71200a7070 con 0x7f71200a72f0 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f712009cee0 con 0x7f712013f350 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 10 monclient(hunting): authenticate will time out at 1171.477182s 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711e7fc640 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f71200a72f0 0x7f712013dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:33770/0 (socket says 172.21.15.73:33770) 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711f7fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f712013f350 0x7f7120141740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:39226/0 (socket says 172.21.15.73:39226) 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711e7fc640 1 -- 172.21.15.73:0/962389314 learned_addr learned my addr 172.21.15.73:0/962389314 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:29.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3593031624 0 0) 0x7f71200a7070 con 0x7f71200a72f0 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): my global_id is 135083 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7108003520 con 0x7f71200a72f0 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168433742 0 0) 0x7f712009cee0 con 0x7f712013f350 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): my global_id is 6547 2024-09-11T02:05:29.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71200a7070 con 0x7f712013f350 2024-09-11T02:05:29.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335643527 0 0) 0x7f712009ca00 con 0x7f7120138d40 2024-09-11T02:05:29.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient(hunting): my global_id is 144271 2024-09-11T02:05:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f712009cee0 con 0x7f7120138d40 2024-09-11T02:05:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 893861674 0 0) 0x7f71200a7070 con 0x7f712013f350 2024-09-11T02:05:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 >> v1:172.21.15.73:6790/0 conn(0x7f71200a72f0 legacy=0x7f712013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 >> v1:172.21.15.203:6789/0 conn(0x7f7120138d40 legacy=0x7f7120139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: _finish_hunting 0 2024-09-11T02:05:29.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 monclient: found mon.noname-c 2024-09-11T02:05:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.73:6791/0 2024-09-11T02:05:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712009d1c0 con 0x7f712013f350 2024-09-11T02:05:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: _finish_auth 0 2024-09-11T02:05:29.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: _check_auth_tickets 2024-09-11T02:05:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 5 monclient: authenticate success, global_id 6547 2024-09-11T02:05:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7118001b90 con 0x7f712013f350 2024-09-11T02:05:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:29.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: dump: 2024-09-11T02:05:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.891 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.892 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.892 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.892 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.892 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.892 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.892 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.892 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.893 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-11T02:05:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 <== mon.4 v1:172.21.15.73:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7118001db0 con 0x7f712013f350 2024-09-11T02:05:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 1 -- 172.21.15.73:0/962389314 <== mon.4 v1:172.21.15.73:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7118004ea0 con 0x7f712013f350 2024-09-11T02:05:29.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 10 monclient: get_monmap_and_config success 2024-09-11T02:05:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f712567f640 4 set_mon_vals no callback set 2024-09-11T02:05:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.873+0000 7f711dffb640 10 monclient: dump: 2024-09-11T02:05:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.895 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.896 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.896 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.896 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.896 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.896 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.896 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.874+0000 7f712567f640 10 monclient: shutdown 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.874+0000 7f712567f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.874+0000 7f712567f640 1 -- 172.21.15.73:0/962389314 >> v1:172.21.15.73:6791/0 conn(0x7f712013f350 legacy=0x7f7120141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.874+0000 7f712567f640 1 -- 172.21.15.73:0/962389314 shutdown_connections 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.874+0000 7f712567f640 1 -- 172.21.15.73:0/962389314 >> 172.21.15.73:0/962389314 conn(0x7f71200a8050 msgr2=0x7f71200a8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.874+0000 7f712567f640 1 -- 172.21.15.73:0/962389314 shutdown_connections 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.874+0000 7f712567f640 1 -- 172.21.15.73:0/962389314 wait complete. 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.874+0000 7f712567f640 10 monclient: build_initial_monmap 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 10 monclient: monmap: 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 0 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-11T02:05:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 0.000000 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:created 0.000000 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 0 (unknown) 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 1 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.noname-a 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.noname-f 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.noname-b 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.noname-g 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.noname-c 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.noname-h 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.noname-d 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.noname-i 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.noname-e 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 1 Processor -- start 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 1 -- start start 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 10 monclient: init 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 10 monclient: _reopen_session rank -1 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 10 monclient: _add_conns ranks=[8,6,4,3,0,5,1,7,2] 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 10 monclient(hunting): picked mon.noname-e con 0x7f71200a72f0 addr v1:172.21.15.73:6793/0 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 10 monclient(hunting): picked mon.noname-d con 0x7f7120138d40 addr v1:172.21.15.73:6792/0 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 10 monclient(hunting): picked mon.noname-c con 0x7f712013f350 addr v1:172.21.15.73:6791/0 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 1 -- --> v1:172.21.15.73:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71200a17f0 con 0x7f712013f350 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 1 -- --> v1:172.21.15.73:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f712009fa60 con 0x7f7120138d40 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 1 -- --> v1:172.21.15.73:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71200a5210 con 0x7f71200a72f0 2024-09-11T02:05:29.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 10 monclient(hunting): _renew_subs 2024-09-11T02:05:29.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.875+0000 7f712567f640 10 monclient(hunting): authenticate will time out at 1171.479980s 2024-09-11T02:05:29.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f711f7fe640 1 --1- >> v1:172.21.15.73:6791/0 conn(0x7f712013f350 0x7f71201d5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6791/0 says I am v1:172.21.15.73:39234/0 (socket says 172.21.15.73:39234) 2024-09-11T02:05:29.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f711f7fe640 1 -- 172.21.15.73:0/4088809718 learned_addr learned my addr 172.21.15.73:0/4088809718 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-11T02:05:29.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f711effd640 1 --1- 172.21.15.73:0/4088809718 >> v1:172.21.15.73:6793/0 conn(0x7f71200a72f0 0x7f712009ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6793/0 says I am v1:172.21.15.73:46430/0 (socket says 172.21.15.73:46430) 2024-09-11T02:05:29.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505931241 0 0) 0x7f71200a17f0 con 0x7f712013f350 2024-09-11T02:05:29.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): my global_id is 6556 2024-09-11T02:05:29.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f710c003550 con 0x7f712013f350 2024-09-11T02:05:29.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.8 v1:172.21.15.73:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692110043 0 0) 0x7f71200a5210 con 0x7f71200a72f0 2024-09-11T02:05:29.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): my global_id is 115775 2024-09-11T02:05:29.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71200a17f0 con 0x7f71200a72f0 2024-09-11T02:05:29.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.6 v1:172.21.15.73:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2318726687 0 0) 0x7f712009fa60 con 0x7f7120138d40 2024-09-11T02:05:29.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _negotiate 2024-09-11T02:05:29.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _init_auth method 2 2024-09-11T02:05:29.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-11T02:05:29.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): my global_id is 115827 2024-09-11T02:05:29.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71200a5210 con 0x7f7120138d40 2024-09-11T02:05:29.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3184042046 0 0) 0x7f710c003550 con 0x7f712013f350 2024-09-11T02:05:29.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f712009fa60 con 0x7f712013f350 2024-09-11T02:05:29.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7118001f60 con 0x7f712013f350 2024-09-11T02:05:29.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:29.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-11T02:05:29.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): dump: 2024-09-11T02:05:29.904 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.904 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.904 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.905 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.905 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.905 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.905 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.905 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.905 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.906 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.906 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.906 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.906 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.906 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.906 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.907 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): _finish_auth 0 2024-09-11T02:05:29.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.8 v1:172.21.15.73:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 262396040 0 0) 0x7f71200a17f0 con 0x7f71200a72f0 2024-09-11T02:05:29.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f710c003550 con 0x7f71200a72f0 2024-09-11T02:05:29.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.6 v1:172.21.15.73:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4287643752 0 0) 0x7f71200a5210 con 0x7f7120138d40 2024-09-11T02:05:29.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71200a17f0 con 0x7f7120138d40 2024-09-11T02:05:29.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.8 v1:172.21.15.73:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7110001a90 con 0x7f71200a72f0 2024-09-11T02:05:29.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:29.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-11T02:05:29.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): dump: 2024-09-11T02:05:29.908 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.909 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.909 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.909 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.909 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.909 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.909 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.910 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.910 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.910 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.910 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.910 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.910 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.911 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.911 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.911 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.6 v1:172.21.15.73:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7114001380 con 0x7f7120138d40 2024-09-11T02:05:29.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-11T02:05:29.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-11T02:05:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient(hunting): dump: 2024-09-11T02:05:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.912 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.913 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.913 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.913 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.913 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.913 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.913 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.914 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.914 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.914 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.914 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.914 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2945405931 0 0) 0x7f712009fa60 con 0x7f712013f350 2024-09-11T02:05:29.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 >> v1:172.21.15.73:6793/0 conn(0x7f71200a72f0 legacy=0x7f712009ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 >> v1:172.21.15.73:6792/0 conn(0x7f7120138d40 legacy=0x7f712009f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:29.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient: _finish_hunting 0 2024-09-11T02:05:29.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 monclient: found mon.c 2024-09-11T02:05:29.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-11T02:05:29.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:29.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71200a02d0 con 0x7f712013f350 2024-09-11T02:05:29.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient: _finish_auth 0 2024-09-11T02:05:29.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 10 monclient: _check_auth_tickets 2024-09-11T02:05:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f71077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-11T02:05:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f712567f640 5 monclient: authenticate success, global_id 6556 2024-09-11T02:05:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f712567f640 10 monclient: _renew_subs 2024-09-11T02:05:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f712567f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:29.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f71200a1510 con 0x7f712013f350 2024-09-11T02:05:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f712567f640 10 monclient: _renew_subs 2024-09-11T02:05:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f712567f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.876+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f71201426c0 con 0x7f712013f350 2024-09-11T02:05:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.877+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71180014e0 con 0x7f712013f350 2024-09-11T02:05:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.877+0000 7f71077fe640 10 monclient: handle_config config(0 keys) 2024-09-11T02:05:29.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.877+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 3737946237 0 0) 0x7f7118005150 con 0x7f712013f350 2024-09-11T02:05:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.877+0000 7f71077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-11T02:05:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.877+0000 7f71077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-11T02:05:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.877+0000 7f711d7fa640 4 set_mon_vals no callback set 2024-09-11T02:05:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.877+0000 7f71077fe640 10 monclient: dump: 2024-09-11T02:05:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:epoch 1 2024-09-11T02:05:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:fsid 8cb5cb9a-3379-4e99-9a99-10d441f3d8e4 2024-09-11T02:05:29.919 INFO:teuthology.orchestra.run.smithi073.stderr:last_changed 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:created 2024-09-11T01:57:30.356953+0000 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:min_mon_release 19 (squid) 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:election_strategy: 3 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:0: v1:172.21.15.73:6789/0 mon.a 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:1: v1:172.21.15.203:6789/0 mon.f 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:2: v1:172.21.15.73:6790/0 mon.b 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:3: v1:172.21.15.203:6790/0 mon.g 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:4: v1:172.21.15.73:6791/0 mon.c 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:5: v1:172.21.15.203:6791/0 mon.h 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:6: v1:172.21.15.73:6792/0 mon.d 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:7: v1:172.21.15.203:6792/0 mon.i 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:8: v1:172.21.15.73:6793/0 mon.e 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:29.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.877+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 7 ==== mgrmap(e 5) ==== 50578+0+0 (unknown 3610805907 0 0) 0x7f7118011890 con 0x7f712013f350 2024-09-11T02:05:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.878+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 8 ==== osd_map(317..317 src has 218..317) ==== 3506+0+0 (unknown 2239662476 0 0) 0x7f711804e490 con 0x7f712013f350 2024-09-11T02:05:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.878+0000 7f712567f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.878+0000 7f712567f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.878+0000 7f712567f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.878+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7100005080 con 0x7f712013f350 2024-09-11T02:05:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.878+0000 7f711effd640 10 monclient: get_auth_request con 0x7f710c040900 auth_method 0 2024-09-11T02:05:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.882+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196006 (unknown 1092875540 0 1238397134) 0x7f7118017770 con 0x7f712013f350 2024-09-11T02:05:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.882+0000 7f71077fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-11T02:05:29.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:29.882+0000 7f71077fe640 10 monclient: _finish_command 1 = system:0 2024-09-11T02:05:30.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.058+0000 7f712567f640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-09-11T02:05:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.058+0000 7f712567f640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-09-11T02:05:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.058+0000 7f712567f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.73:6791/0 2024-09-11T02:05:30.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.058+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 --> v1:172.21.15.73:6791/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f7100005370 con 0x7f712013f350 2024-09-11T02:05:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.063+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7f7118016c50 con 0x7f712013f350 2024-09-11T02:05:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.064+0000 7f71077fe640 10 monclient: handle_config config(1 keys) 2024-09-11T02:05:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.064+0000 7f711d7fa640 4 set_mon_vals no callback set 2024-09-11T02:05:30.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.064+0000 7f711d7fa640 10 set_mon_vals mon_health_to_clog = false 2024-09-11T02:05:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.064+0000 7f71077fe640 1 -- 172.21.15.73:0/4088809718 <== mon.4 v1:172.21.15.73:6791/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (unknown 1453024670 0 0) 0x7f711801baf0 con 0x7f712013f350 2024-09-11T02:05:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.064+0000 7f71077fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-09-11T02:05:30.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.064+0000 7f71077fe640 10 monclient: _finish_command 2 = system:0 2024-09-11T02:05:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.066+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 >> v1:172.21.15.203:6812/2311533528 conn(0x7f710c040900 legacy=0x7f710c042dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.066+0000 7f712567f640 10 monclient: shutdown 2024-09-11T02:05:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.066+0000 7f712567f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-11T02:05:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.066+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 >> v1:172.21.15.73:6791/0 conn(0x7f712013f350 legacy=0x7f71201d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T02:05:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.066+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 shutdown_connections 2024-09-11T02:05:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.066+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 >> 172.21.15.73:0/4088809718 conn(0x7f71200a8050 msgr2=0x7f71201319f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T02:05:30.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.066+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 shutdown_connections 2024-09-11T02:05:30.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-11T02:05:30.066+0000 7f712567f640 1 -- 172.21.15.73:0/4088809718 wait complete. 2024-09-11T02:05:30.079 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T02:05:30.079 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T02:05:30.079 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T02:05:30.079 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.118 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T02:05:30.118 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T02:05:30.118 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.184 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T02:05:30.184 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T02:05:30.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.259 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T02:05:30.259 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T02:05:30.259 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.293 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T02:05:30.294 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T02:05:30.294 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.365 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T02:05:30.365 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T02:05:30.366 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.440 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T02:05:30.440 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T02:05:30.440 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T02:05:30.441 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.510 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T02:05:30.510 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T02:05:30.511 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T02:05:30.511 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.524 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T02:05:30.524 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T02:05:30.524 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.576 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T02:05:30.576 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T02:05:30.576 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.629 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T02:05:30.629 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-09-11T02:05:30.629 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.681 INFO:tasks.ceph.mon.d:Stopped 2024-09-11T02:05:30.681 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-09-11T02:05:30.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.733 INFO:tasks.ceph.mon.e:Stopped 2024-09-11T02:05:30.733 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-09-11T02:05:30.733 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.746 INFO:tasks.ceph.mon.f:Stopped 2024-09-11T02:05:30.747 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-09-11T02:05:30.747 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.802 INFO:tasks.ceph.mon.g:Stopped 2024-09-11T02:05:30.802 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-09-11T02:05:30.802 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.854 INFO:tasks.ceph.mon.h:Stopped 2024-09-11T02:05:30.855 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-09-11T02:05:30.855 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T02:05:30.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-11T02:05:30.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-11T02:05:30.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-11T02:05:30.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-11T02:05:30.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-11T02:05:30.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-11T02:05:30.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.d is failed for ~0s 2024-09-11T02:05:30.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e is failed for ~0s 2024-09-11T02:05:30.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.f is failed for ~0s 2024-09-11T02:05:30.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.g is failed for ~0s 2024-09-11T02:05:30.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.h is failed for ~0s 2024-09-11T02:05:30.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.i is failed for ~0s 2024-09-11T02:05:30.910 INFO:tasks.ceph.mon.i:Stopped 2024-09-11T02:05:30.910 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T02:05:30.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | head -n 1 2024-09-11T02:05:30.953 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-11T02:05:30.953 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T02:05:31.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-11T02:05:31.211 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T02:05:31.333 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-11T02:05:31.334 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T02:05:31.400 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T02:05:31.400 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T02:05:31.576 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T02:05:31.576 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T02:05:31.639 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T02:05:31.639 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T02:05:31.695 INFO:tasks.ceph:Archiving mon data... 2024-09-11T02:05:31.697 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/data/mon.a.tgz 2024-09-11T02:05:31.697 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-11T02:05:31.712 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.o2GUmS3fSG 2024-09-11T02:05:31.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.o2GUmS3fSG 2024-09-11T02:05:31.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.o2GUmS3fSG 2024-09-11T02:05:31.905 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.o2GUmS3fSG is 208KB 2024-09-11T02:05:32.000 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.o2GUmS3fSG 2024-09-11T02:05:32.015 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/data/mon.b.tgz 2024-09-11T02:05:32.015 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-11T02:05:32.069 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.CySg6qITuI 2024-09-11T02:05:32.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.CySg6qITuI 2024-09-11T02:05:32.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.CySg6qITuI 2024-09-11T02:05:32.248 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.CySg6qITuI is 202KB 2024-09-11T02:05:32.301 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.CySg6qITuI 2024-09-11T02:05:32.316 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/data/mon.c.tgz 2024-09-11T02:05:32.316 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-11T02:05:32.371 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.teinc1Qs8X 2024-09-11T02:05:32.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.teinc1Qs8X 2024-09-11T02:05:32.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.teinc1Qs8X 2024-09-11T02:05:32.550 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.teinc1Qs8X is 209KB 2024-09-11T02:05:32.643 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.teinc1Qs8X 2024-09-11T02:05:32.658 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-d to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/data/mon.d.tgz 2024-09-11T02:05:32.658 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-11T02:05:32.712 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.CGXE0HeEvi 2024-09-11T02:05:32.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-d -- . > /tmp/tmp.CGXE0HeEvi 2024-09-11T02:05:32.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.CGXE0HeEvi 2024-09-11T02:05:32.890 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.CGXE0HeEvi is 203KB 2024-09-11T02:05:32.943 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.CGXE0HeEvi 2024-09-11T02:05:32.958 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-e to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/data/mon.e.tgz 2024-09-11T02:05:32.958 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-11T02:05:33.012 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.Ln0vriVhNb 2024-09-11T02:05:33.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-e -- . > /tmp/tmp.Ln0vriVhNb 2024-09-11T02:05:33.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.Ln0vriVhNb 2024-09-11T02:05:33.190 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.Ln0vriVhNb is 203KB 2024-09-11T02:05:33.242 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.Ln0vriVhNb 2024-09-11T02:05:33.257 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-f to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/data/mon.f.tgz 2024-09-11T02:05:33.257 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-09-11T02:05:33.276 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.kJjiEmhx4C 2024-09-11T02:05:33.277 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-f -- . > /tmp/tmp.kJjiEmhx4C 2024-09-11T02:05:33.388 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.kJjiEmhx4C 2024-09-11T02:05:33.474 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.kJjiEmhx4C is 199KB 2024-09-11T02:05:33.526 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.kJjiEmhx4C 2024-09-11T02:05:33.542 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-g to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/data/mon.g.tgz 2024-09-11T02:05:33.542 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-09-11T02:05:33.597 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.QnkfDOcYYC 2024-09-11T02:05:33.597 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-g -- . > /tmp/tmp.QnkfDOcYYC 2024-09-11T02:05:33.694 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.QnkfDOcYYC 2024-09-11T02:05:33.777 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.QnkfDOcYYC is 209KB 2024-09-11T02:05:33.871 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.QnkfDOcYYC 2024-09-11T02:05:33.886 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-h to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/data/mon.h.tgz 2024-09-11T02:05:33.887 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-09-11T02:05:33.941 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.WaW3iWMwL0 2024-09-11T02:05:33.941 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-h -- . > /tmp/tmp.WaW3iWMwL0 2024-09-11T02:05:34.036 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.WaW3iWMwL0 2024-09-11T02:05:34.119 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.WaW3iWMwL0 is 200KB 2024-09-11T02:05:34.171 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.WaW3iWMwL0 2024-09-11T02:05:34.186 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-i to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/data/mon.i.tgz 2024-09-11T02:05:34.186 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-09-11T02:05:34.240 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.UVa7Z9f8RP 2024-09-11T02:05:34.241 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-i -- . > /tmp/tmp.UVa7Z9f8RP 2024-09-11T02:05:34.335 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.UVa7Z9f8RP 2024-09-11T02:05:34.418 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.UVa7Z9f8RP is 209KB 2024-09-11T02:05:34.513 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.UVa7Z9f8RP 2024-09-11T02:05:34.528 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T02:05:34.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T02:05:34.530 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T02:05:34.618 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T02:05:34.648 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T02:05:34.648 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T02:05:34.650 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/remote/smithi073/crash 2024-09-11T02:05:34.650 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T02:05:34.686 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/crash to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/remote/smithi203/crash 2024-09-11T02:05:34.687 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T02:05:34.712 INFO:tasks.ceph:Compressing logs... 2024-09-11T02:05:34.712 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T02:05:34.731 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T02:05:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T02:05:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37466.log 2024-09-11T02:05:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-osd.0.log: --verbose -- /var/log/ceph/ceph-client.admin.40639.log 2024-09-11T02:05:34.766 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35346.log 2024-09-11T02:05:34.766 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40639.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37466.log.gz 2024-09-11T02:05:34.766 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37382.log 2024-09-11T02:05:34.766 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40639.log.gz 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38843.log 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35346.log: /var/log/ceph/ceph-client.admin.37382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39180.log 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38843.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35346.log.gz 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40176.log 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37382.log.gz 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39180.log: gzip -5 89.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38843.log.gz 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.37214.log 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35604.log 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39180.log.gz 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39728.log 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40176.log.gz 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3%/var/log/ceph/ceph-client.admin.35604.log: -- replaced with /var/log/ceph/ceph-client.admin.37214.log.gz 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37424.log 2024-09-11T02:05:34.767 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37592.log 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35604.log.gz 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37424.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39728.log.gz 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37592.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37424.log.gz 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38449.log 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32273.log 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37592.log.gz 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36937.log 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3%/var/log/ceph/ceph-client.admin.32273.log: -- replaced with /var/log/ceph/ceph-client.admin.38449.log.gz 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32273.log.gz 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38056.log 2024-09-11T02:05:34.768 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36937.log: /var/log/ceph/ceph-client.admin.35525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36305.log 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38056.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36937.log.gz 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gz 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40344.log 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38056.log.gz 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39770.log 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36305.log: /var/log/ceph/ceph-client.admin.40344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36221.log 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39770.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36305.log.gz 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40344.log.gz 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36767.log 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36093.log 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9%/var/log/ceph/ceph-client.admin.36221.log: -- replaced with /var/log/ceph/ceph-client.admin.39770.log.gz 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38407.log 2024-09-11T02:05:34.769 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36221.log.gz 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41101.log 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36767.log.gz 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1%/var/log/ceph/ceph-client.admin.38407.log: -- replaced with /var/log/ceph/ceph-client.admin.36093.log.gz 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38197.log 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38407.log.gz 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39138.log 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31856.log 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41101.log.gz 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40050.log 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38197.log.gz 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.31856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40891.log 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39138.log.gz 2024-09-11T02:05:34.770 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41143.log 2024-09-11T02:05:34.771 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31856.log.gz 2024-09-11T02:05:34.771 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40891.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40050.log.gz 2024-09-11T02:05:34.771 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40723.log 2024-09-11T02:05:34.771 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40891.log.gz 2024-09-11T02:05:34.771 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.41143.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35757.log 2024-09-11T02:05:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37930.log 2024-09-11T02:05:34.861 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41143.log.gz 2024-09-11T02:05:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35757.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40723.log.gz 2024-09-11T02:05:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36515.log 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35757.log.gz 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36683.log 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37930.log: /var/log/ceph/ceph-client.admin.36515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35127.log 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2%/var/log/ceph/ceph-client.admin.36683.log: -- replaced with /var/log/ceph/ceph-client.admin.37930.log.gz 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36515.log.gz 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41183.log 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36263.log 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36683.log.gz 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35127.log: /var/log/ceph/ceph-client.admin.41183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35883.log 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35127.log.gz 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36263.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41183.log.gz 2024-09-11T02:05:34.862 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39306.log 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36263.log.gz 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38717.log 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35883.log.gz 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40429.log 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39306.log: /var/log/ceph/ceph-client.admin.38717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36135.log 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39306.log.gz 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38717.log.gz 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36641.log 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40008.log 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36135.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40429.log.gz 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35524.log 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36135.log.gz 2024-09-11T02:05:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40975.log 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36641.log.gz 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37340.log 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35524.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40008.log.gz 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37550.log 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35524.log.gz 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr: 96.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37340.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40975.log.gz 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27186.log 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.37340.log.gz -5 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36389.log 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37550.log: /var/log/ceph/ceph.tmp-client.admin.27186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39644.log 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27186.log.gz 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36389.log: gzip 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.37550.log.gz -- 2024-09-11T02:05:34.864 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.35348.log 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39644.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36389.log.gz 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36051.log 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37256.log 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35348.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39644.log.gz 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36599.log 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35348.log.gz 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38970.log 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36051.log.gz 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36599.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37256.log.gz 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35169.log 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35350.log 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38970.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36599.log.gz 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36347.log 2024-09-11T02:05:34.865 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35350.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38970.log.gz 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38552.log 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35169.log.gz 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35350.log.gz 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36851.log 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36347.log.gz 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36895.log 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38552.log: /var/log/ceph/ceph-client.admin.36851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40302.log 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36895.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38552.log.gz 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36851.log.gz 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40302.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36895.log.gz 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34753.log 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.c.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40302.log.gz 2024-09-11T02:05:34.866 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41059.log 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39390.log 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34753.log: /var/log/ceph/ceph-client.admin.41059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37172.log 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34753.log.gz 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37678.log 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41059.log.gz 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37172.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39390.log.gz -5 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39474.log 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38927.log 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37678.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37172.log.gz 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40387.log 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37678.log.gz 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36431.log 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39474.log.gz 2024-09-11T02:05:34.867 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40387.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38927.log.gz -- 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.40134.log 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37846.log 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36431.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40387.log.gz 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38633.log 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36431.log.gz 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39560.log 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40134.log.gz 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37846.log: /var/log/ceph/ceph-client.admin.38633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39686.log 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38633.log.gz 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39560.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37846.log.gz 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39924.log 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39686.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39560.log.gz 2024-09-11T02:05:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40513.log 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35349.log 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39686.log.gz 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39924.log.gz 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39602.log 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35349.log: 87.8%/var/log/ceph/ceph-client.admin.39602.log: -- replaced with /var/log/ceph/ceph-client.admin.40513.log.gz 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.e.log 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35349.log.gz 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.a.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39602.log.gz 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40933.log 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32205.log 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.e.log: /var/log/ceph/ceph-client.admin.40933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40218.log 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32205.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40933.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40807.log 2024-09-11T02:05:34.869 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37888.log 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32205.log.gz 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40218.log: /var/log/ceph/ceph-client.admin.40807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34953.log 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37888.log: 87.9% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40218.log.gz 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40807.log.gz 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38675.log 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37888.log.gz 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34953.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36473.log 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34953.log.gz 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38675.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40765.log 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36473.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38675.log.gz 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35841.log 2024-09-11T02:05:34.870 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36473.log.gz 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35967.log 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35841.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40765.log.gz 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr: 86.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39012.log 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35841.log.gz 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37972.log 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35967.log: /var/log/ceph/ceph-client.admin.39012.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35967.log.gz 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39012.log.gz 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36557.log 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35925.log 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37972.log.gz 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39096.log 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35925.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36557.log.gz 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35009.log 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35925.log.gz 2024-09-11T02:05:34.871 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35353.log 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35009.log: 89.3% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39096.log.gz 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35009.log.gz 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35211.log 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.35353.log.gz 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37298.log 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35211.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35211.log.gz 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35601.log 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37298.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37298.log.gz 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39432.log 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35601.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35601.log.gz 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40092.log 2024-09-11T02:05:34.872 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39432.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39432.log.gz 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35605.log 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40092.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40092.log.gz 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38281.log 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35605.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35605.log.gz 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38759.log 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38281.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38281.log.gz 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37508.log 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38759.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38759.log.gz 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35599.log 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37508.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37508.log.gz 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37804.log 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35599.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35599.log.gz 2024-09-11T02:05:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36809.log 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37804.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37804.log.gz 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.d.log 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36809.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36809.log.gz 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39054.log 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.d.log: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39966.log 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39054.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39054.log.gz 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39222.log 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39966.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39966.log.gz 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38491.log 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39222.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39222.log.gz 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T02:05:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38491.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38491.log.gz 2024-09-11T02:05:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35034.log 2024-09-11T02:05:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35777.log 2024-09-11T02:05:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35034.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35034.log.gz 2024-09-11T02:05:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37762.log 2024-09-11T02:05:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35777.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35777.log.gz 2024-09-11T02:05:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36177.log 2024-09-11T02:05:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37762.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37762.log.gz 2024-09-11T02:05:34.877 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35352.log 2024-09-11T02:05:34.878 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36177.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36177.log.gz 2024-09-11T02:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39264.log 2024-09-11T02:05:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35352.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35352.log.gz 2024-09-11T02:05:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39348.log 2024-09-11T02:05:34.919 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37636.log 2024-09-11T02:05:34.919 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39348.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39264.log.gz 2024-09-11T02:05:34.925 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38323.log 2024-09-11T02:05:34.925 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37636.log: 87.9% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39348.log.gz 2024-09-11T02:05:34.931 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40555.log 2024-09-11T02:05:34.938 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38323.log: -- replaced with /var/log/ceph/ceph-client.admin.37636.log.gz 2024-09-11T02:05:34.946 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40260.log 2024-09-11T02:05:34.946 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40555.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40555.log.gz 2024-09-11T02:05:34.946 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38323.log.gz 2024-09-11T02:05:34.960 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35008.log 2024-09-11T02:05:34.960 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39664.log 2024-09-11T02:05:34.960 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37460.log 2024-09-11T02:05:34.960 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37781.log 2024-09-11T02:05:34.960 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39664.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35008.log.gz 2024-09-11T02:05:34.960 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36486.log 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37781.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39664.log.gz 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38799.log 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35248.log 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37460.log.gz 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37781.log.gz 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38419.log 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39834.log 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35248.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36486.log.gz 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38799.log.gz 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37565.log 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35248.log.gz 2024-09-11T02:05:34.961 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38902.log 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36451.log 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38419.log.gz 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39765.log 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39834.log.gz 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39114.log 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37565.log.gz 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39765.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38902.log.gz 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.36451.log.gz 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35454.log 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37994.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39765.log.gz 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37351.log 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39114.log.gz 2024-09-11T02:05:34.962 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35144.log 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38172.log 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35454.log.gz 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36923.log 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40087.log 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37351.log.gz 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37458.log 88.5% 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38172.log.gz 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35144.log.gz 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.40087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37316.log 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38903.log 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36923.log.gz 2024-09-11T02:05:34.963 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37316.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40087.log.gz 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36995.log 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.37316.log.gz -5 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr: --verbose -- /var/log/ceph/ceph-mon.g.log 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38903.log: /var/log/ceph/ceph-client.admin.36995.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37458.log.gz 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35145.log 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38903.log.gz 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.g.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39767.log 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36995.log.gz 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38626.log 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38627.log 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35145.log.gz 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39044.log 2024-09-11T02:05:34.964 INFO:teuthology.orchestra.run.smithi203.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39767.log.gz 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36818.log 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39629.log 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2%/var/log/ceph/ceph-client.admin.39044.log: -- replaced with /var/log/ceph/ceph-client.admin.38626.log.gz 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38627.log.gz 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38798.log 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.39044.log.gz 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38833.log 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.39629.log.gz 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38798.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36818.log.gz 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36244.log 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37137.log 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38833.log: /var/log/ceph/ceph-client.admin.36244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35042.log 2024-09-11T02:05:34.965 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37137.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38833.log.gz 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38798.log.gz 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39938.log 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37315.log 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35042.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36244.log.gz 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32010.log 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37137.log.gz 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35042.log.gz 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36280.log 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37315.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39938.log.gz 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.32010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38523.log 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38591.log 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32010.log.gz 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37315.log.gz 2024-09-11T02:05:34.966 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34905.log 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36280.log.gz 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36603.log 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38523.log.gz 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.34905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36278.log 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36603.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38591.log.gz 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36382.log 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34905.log.gz 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36603.log.gz 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38100.log 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35420.log 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31970.log 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36382.log.gz 2024-09-11T02:05:34.967 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36278.log.gz 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36142.log 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.31970.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35420.log.gz 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38100.log.gz 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36279.log 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37850.log 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31970.log.gz 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36142.log: /var/log/ceph/ceph-client.admin.36279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39937.log 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37850.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36142.log.gz 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38064.log 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36279.log.gz 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36816.log 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38207.log 2024-09-11T02:05:34.968 INFO:teuthology.orchestra.run.smithi203.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37850.log.gz 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38488.log 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39937.log.gz 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39216.log 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38207.log: /var/log/ceph/ceph-client.admin.38488.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38064.log.gz 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35558.log 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36816.log.gz 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37244.log 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38207.log.gz 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39766.log 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35558.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38488.log.gz 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39113.log 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35832.log 2024-09-11T02:05:34.969 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39216.log.gz 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35558.log.gz 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39113.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37244.log.gz 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35041.log 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39766.log.gz 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.35832.log: -- /var/log/ceph/ceph-client.admin.36072.log 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35041.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39113.log.gz 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37208.log 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35832.log.gz 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37139.log 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36072.log: /var/log/ceph/ceph-client.admin.37208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35146.log 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35041.log.gz 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34940.log 2024-09-11T02:05:34.970 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35146.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37208.log.gz 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36072.log.gz 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37139.log.gz 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.34940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37422.log 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38316.log 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35146.log.gz 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35969.log 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34940.log.gz 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr:gzip/var/log/ceph/ceph-client.admin.38316.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36780.log 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35969.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37422.log.gz -5 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37352.log 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39148.log 2024-09-11T02:05:34.971 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35969.log.gz 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37352.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38316.log.gz 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37245.log 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39148.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37352.log.gz 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36780.log.gz 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39628.log 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39148.log.gz 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35970.log 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37245.log.gz 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36888.log 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31890.log 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35247.log 2024-09-11T02:05:34.972 INFO:teuthology.orchestra.run.smithi203.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35970.log.gz 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39628.log.gz 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.31890.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36888.log.gz 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36073.log 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35247.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31890.log.gz 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39319.log 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36141.log 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr:gzip/var/log/ceph/ceph-client.admin.39319.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35247.log.gz 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39251.log 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36073.log.gz 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr: 96.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35111.log 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38385.log 2024-09-11T02:05:34.973 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39319.log.gz 2024-09-11T02:05:34.974 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39252.log 2024-09-11T02:05:34.976 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36141.log.gz -- replaced with /var/log/ceph/ceph-client.admin.39251.log.gz 2024-09-11T02:05:34.976 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T02:05:34.976 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39353.log 2024-09-11T02:05:34.976 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35111.log.gz 2024-09-11T02:05:34.976 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38208.log 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36175.log 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr: 89.1%/var/log/ceph/ceph-client.admin.38208.log: gzip 88.3% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38385.log.gz 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr: /var/log/ceph/ceph-client.admin.36348.log 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39252.log.gz 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35935.log 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38208.log.gz 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39353.log.gz 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37779.log 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34939.log 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35935.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36348.log.gz 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36175.log.gz 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37672.log 2024-09-11T02:05:34.977 INFO:teuthology.orchestra.run.smithi203.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35935.log.gz 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.34939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36039.log 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35762.log 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34939.log.gz 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37779.log.gz 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32054.log 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31930.log 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35762.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36039.log.gz 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37672.log.gz 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.32054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39456.log 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37780.log 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.31930.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32054.log.gz 2024-09-11T02:05:34.978 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38102.log 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35762.log.gz 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31930.log.gz 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38696.log 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38102.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39456.log.gz 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35249.log 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37780.log.gz 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38696.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38102.log.gz 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35522.log 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36925.log 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38696.log.gz 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35350.log 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35249.log.gz 2024-09-11T02:05:34.979 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36347.log 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5/var/log/ceph/ceph-client.admin.35350.log: --verbose -- /var/log/ceph/ceph-client.admin.35625.log 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35522.log.gz 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35557.log 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36925.log.gz 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38938.log 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35350.log.gz/var/log/ceph/ceph-client.admin.35557.log: 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36176.log 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36347.log.gz 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38938.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35557.log.gz 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35007.log 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35625.log.gz 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37530.log 2024-09-11T02:05:34.980 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38938.log.gz 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35007.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36176.log.gz 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35351.log 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38386.log 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37530.log: /var/log/ceph/ceph-client.admin.35351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38315.log 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35007.log.gz 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37530.log.gz 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35351.log.gz 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39147.log 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39560.log 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38386.log.gz 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38315.log: /var/log/ceph/ceph-client.admin.39147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37886.log 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36484.log 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38315.log.gz 2024-09-11T02:05:34.981 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37886.log: gzip 88.3% -5 --verbose -- /var/log/ceph/ceph-client.admin.39561.log 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39560.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39147.log.gz 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38065.log 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39869.log 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37886.log.gz 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34938.log 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39561.log.gz 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36484.log.gz 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35455.log 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38065.log.gz 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35729.log 2024-09-11T02:05:34.982 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.34938.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39869.log.gz 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39732.log 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35728.log 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35729.log.gz 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39732.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35455.log.gz 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34938.log.gz 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36553.log 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39009.log 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39732.log.gz 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37423.log 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35556.log 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37423.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35728.log.gz 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36553.log.gz 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36887.log 2024-09-11T02:05:34.983 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36038.log 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39009.log.gz 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr: 88.4%/var/log/ceph/ceph-client.admin.35556.log: -- replaced with /var/log/ceph/ceph-client.admin.37423.log.gz 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37209.log 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37032.log 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9%/var/log/ceph/ceph-client.admin.37209.log: -- replaced with /var/log/ceph/ceph-client.admin.35556.log.gz 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36887.log.gz 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36038.log.gz 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.h.log 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37209.log.gz 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37032.log: /var/log/ceph/ceph-client.admin.37138.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.i.log 2024-09-11T02:05:34.984 INFO:teuthology.orchestra.run.smithi203.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.h.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36709.log 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37032.log.gz 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.i.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37031.log 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37995.log 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35764.log 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37995.log: 88.1% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36709.log.gz 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36711.log 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37031.log.gz 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5/var/log/ceph/ceph-client.admin.35764.log: --verbose -- /var/log/ceph/ceph-client.admin.36673.log 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37995.log.gz/var/log/ceph/ceph-client.admin.36711.log: 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36602.log 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr:gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35764.log.gz 2024-09-11T02:05:34.985 INFO:teuthology.orchestra.run.smithi203.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35317.log 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36711.log.gz 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36602.log: /var/log/ceph/ceph-client.admin.36673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37888.log 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38314.log 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36602.log.gz 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36673.log.gz/var/log/ceph/ceph-client.admin.37888.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35317.log.gz 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39043.log 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38314.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39868.log 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37888.log.gz 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr:gzip/var/log/ceph/ceph-client.admin.39043.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37030.log 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39045.log 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38314.log.gz 2024-09-11T02:05:34.986 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37030.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39043.log.gz 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35968.log 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39868.log.gz 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35213.log 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37030.log.gz 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35659.log 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39045.log.gz 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35968.log: /var/log/ceph/ceph-client.admin.35213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35831.log 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36245.log 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35831.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35213.log.gz 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35968.log.gz 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35659.log.gz 2024-09-11T02:05:34.987 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35626.log 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36245.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35831.log.gz 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39870.log 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35626.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36383.log 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36245.log.gz 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35626.log.gz 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.36383.log: -- /var/log/ceph/ceph-client.admin.35110.log 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36074.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37887.log 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39870.log.gz 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35419.log 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35110.log: 88.7% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36383.log.gz 2024-09-11T02:05:34.988 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37459.log 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37887.log.gz/var/log/ceph/ceph-client.admin.35419.log: 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35110.log.gz 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39422.log 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.5.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35419.log.gz 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37459.log.gz 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5/var/log/ceph/ceph-client.admin.39422.log: --verbose -- /var/log/ceph/ceph-client.admin.39835.log 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36381.log 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39422.log.gz 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37743.log 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36381.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39835.log.gz 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38522.log 2024-09-11T02:05:34.989 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37743.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36381.log.gz 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35660.log 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38522.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37743.log.gz 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37993.log 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35660.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38522.log.gz 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35865.log 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35660.log.gz 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37993.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37993.log.gz 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36924.log 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36485.log 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36924.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35865.log.gz 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36924.log.gz 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38730.log 2024-09-11T02:05:34.990 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36604.log 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr: 88.6%/var/log/ceph/ceph-client.admin.38730.log: -- replaced with /var/log/ceph/ceph-client.admin.36485.log.gz 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38834.log 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36604.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38730.log.gz 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39010.log 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38834.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36604.log.gz 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37566.log 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39010.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38834.log.gz 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34904.log 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39010.log.gz 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37566.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.34904.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37566.log.gz 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38279.log 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mgr.x.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34904.log.gz 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T02:05:34.991 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35453.log 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38628.log 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr: 88.5%/var/log/ceph/ceph-client.admin.35453.log: -- replaced with /var/log/ceph/ceph-client.admin.38279.log.gz 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38695.log 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38628.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35453.log.gz 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39250.log 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38628.log.gz 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31850.log 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38695.log: /var/log/ceph/ceph-client.admin.39250.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38695.log.gz 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39250.log.gz 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35866.log 2024-09-11T02:05:34.992 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37529.log 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35866.log: /var/log/ceph/ceph-client.admin.31850.log: 87.4% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31850.log.gz 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35866.log.gz 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36710.log 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36674.log 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36710.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37529.log.gz 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36710.log.gz 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38832.log 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35661.log 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36674.log.gz 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39423.log 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35661.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38832.log.gz 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35661.log.gz 2024-09-11T02:05:34.993 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39457.log 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36781.log 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39423.log.gz 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38524.log 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36781.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39457.log.gz 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36781.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37102.log 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37958.log 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38524.log: /var/log/ceph/ceph-client.admin.37102.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37102.log.gz 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38524.log.gz 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38101.log 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38171.log 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37958.log.gz 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39354.log 2024-09-11T02:05:34.994 INFO:teuthology.orchestra.run.smithi203.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38101.log.gz 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39355.log 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39354.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38171.log.gz 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39354.log.gz 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38939.log 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35763.log 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38939.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39355.log.gz 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38939.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38937.log 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35214.log 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35763.log.gz 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39458.log 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35214.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35214.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38937.log.gz 2024-09-11T02:05:34.995 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36177.log 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35316.log 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36177.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39458.log.gz 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35352.log 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36177.log.gz/var/log/ceph/ceph-client.admin.35316.log: 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35867.log 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35352.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35316.log.gz 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35934.log 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35867.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35352.log.gz 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38592.log 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35867.log.gz 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37636.log 2024-09-11T02:05:34.996 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38592.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35934.log.gz 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38592.log.gz 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39662.log 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39731.log 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39662.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37636.log.gz 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38731.log 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39662.log.gz/var/log/ceph/ceph-client.admin.39731.log: 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37353.log 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38731.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39731.log.gz 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38489.log 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37353.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38731.log.gz 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38729.log 2024-09-11T02:05:34.997 INFO:teuthology.orchestra.run.smithi203.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37353.log.gz 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37851.log 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38729.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38489.log.gz 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37246.log 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37851.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38729.log.gz 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37851.log.gz 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36450.log 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37101.log 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36450.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37246.log.gz 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.f.log 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37101.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36450.log.gz 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.f.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37101.log.gz 2024-09-11T02:05:34.998 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39559.log 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38278.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37673.log 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39559.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39559.log.gz 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39320.log 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37673.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.37673.log.gz 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39149.log 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39320.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39320.log.gz 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39663.log 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39149.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39149.log.gz 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37637.log 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39663.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39663.log.gz 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37744.log 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37637.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37637.log.gz 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40088.log 2024-09-11T02:05:34.999 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37744.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37744.log.gz 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35523.log 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.40088.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40088.log.gz 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39217.log 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35523.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35523.log.gz 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39217.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39217.log.gz 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38421.log 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39525.log 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38421.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38421.log.gz 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37957.log 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39525.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39525.log.gz 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36994.log 2024-09-11T02:05:35.000 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37957.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37957.log.gz 2024-09-11T02:05:35.001 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39526.log 2024-09-11T02:05:35.001 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36994.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36994.log.gz 2024-09-11T02:05:35.004 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40849.log 2024-09-11T02:05:35.004 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40260.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40260.log.gz 2024-09-11T02:05:35.004 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38014.log 2024-09-11T02:05:35.005 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40849.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40849.log.gz 2024-09-11T02:05:35.005 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36725.log 2024-09-11T02:05:35.005 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38014.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38014.log.gz 2024-09-11T02:05:35.005 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38098.log 2024-09-11T02:05:35.010 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36817.log 2024-09-11T02:05:35.010 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.39526.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39526.log.gz 2024-09-11T02:05:35.010 INFO:teuthology.orchestra.run.smithi203.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35043.log 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36817.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36817.log.gz 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37567.log 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.35043.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35043.log.gz 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40089.log 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37567.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37567.log.gz 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38209.log 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.40089.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40089.log.gz 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36554.log 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38209.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38209.log.gz 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37674.log 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.36554.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36554.log.gz 2024-09-11T02:05:35.011 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38420.log 2024-09-11T02:05:35.012 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.37674.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37674.log.gz 2024-09-11T02:05:35.012 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.38420.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38420.log.gz 2024-09-11T02:05:35.012 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36725.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36725.log.gz 2024-09-11T02:05:35.013 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38801.log 2024-09-11T02:05:35.014 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38098.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38098.log.gz 2024-09-11T02:05:35.023 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38239.log 2024-09-11T02:05:35.024 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38801.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38801.log.gz 2024-09-11T02:05:35.032 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38365.log 2024-09-11T02:05:35.042 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37720.log 2024-09-11T02:05:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38365.log: 88.9% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38239.log.gz 2024-09-11T02:05:35.051 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40681.log 2024-09-11T02:05:35.052 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37720.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37720.log.gz 2024-09-11T02:05:35.055 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38365.log.gz 2024-09-11T02:05:35.060 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40471.log 2024-09-11T02:05:35.070 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40597.log 2024-09-11T02:05:35.073 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40471.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40681.log.gz 2024-09-11T02:05:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39518.log 2024-09-11T02:05:35.081 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40597.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40471.log.gz 2024-09-11T02:05:35.091 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40597.log.gz 2024-09-11T02:05:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35085.log 2024-09-11T02:05:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39518.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39518.log.gz 2024-09-11T02:05:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41017.log 2024-09-11T02:05:35.117 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38140.log 2024-09-11T02:05:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41017.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35085.log.gz 2024-09-11T02:05:35.125 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38885.log 2024-09-11T02:05:35.130 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38140.log: 88.5% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41017.log.gz 2024-09-11T02:05:35.133 INFO:teuthology.orchestra.run.smithi203.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mon.h.log.gz 2024-09-11T02:05:35.134 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39814.log 2024-09-11T02:05:35.137 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38885.log: 90.0% -- replaced with /var/log/ceph/ceph-mon.e.log.gz 2024-09-11T02:05:35.137 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36009.log 2024-09-11T02:05:35.137 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39814.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39814.log.gz 2024-09-11T02:05:35.138 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36009.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36009.log.gz 2024-09-11T02:05:35.139 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38140.log.gz 2024-09-11T02:05:35.139 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38885.log.gz 2024-09-11T02:05:35.149 INFO:teuthology.orchestra.run.smithi073.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mon.d.log.gz 2024-09-11T02:05:35.202 INFO:teuthology.orchestra.run.smithi073.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T02:05:35.247 INFO:teuthology.orchestra.run.smithi203.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mon.i.log.gz 2024-09-11T02:05:35.304 INFO:teuthology.orchestra.run.smithi203.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.g.log.gz 2024-09-11T02:05:35.320 INFO:teuthology.orchestra.run.smithi073.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T02:05:35.402 INFO:teuthology.orchestra.run.smithi203.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.f.log.gz 2024-09-11T02:05:35.495 INFO:teuthology.orchestra.run.smithi073.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T02:05:35.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.d has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.f has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.g has been restored 2024-09-11T02:05:35.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.h has been restored 2024-09-11T02:05:35.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.i has been restored 2024-09-11T02:05:37.039 INFO:teuthology.orchestra.run.smithi073.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T02:05:37.116 INFO:teuthology.orchestra.run.smithi203.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T02:05:37.399 INFO:teuthology.orchestra.run.smithi203.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T02:05:37.457 INFO:teuthology.orchestra.run.smithi203.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T02:05:37.460 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-11T02:05:37.460 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m2.692s 2024-09-11T02:05:37.460 INFO:teuthology.orchestra.run.smithi203.stderr:user 0m9.233s 2024-09-11T02:05:37.460 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m0.450s 2024-09-11T02:05:37.486 INFO:teuthology.orchestra.run.smithi073.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T02:05:37.613 INFO:teuthology.orchestra.run.smithi073.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T02:05:37.615 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-11T02:05:37.615 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m2.871s 2024-09-11T02:05:37.615 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m9.899s 2024-09-11T02:05:37.615 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m0.413s 2024-09-11T02:05:37.616 INFO:tasks.ceph:Archiving logs... 2024-09-11T02:05:37.616 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/remote/smithi073/log 2024-09-11T02:05:37.617 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T02:05:39.299 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/remote/smithi203/log 2024-09-11T02:05:39.300 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T02:05:40.968 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T02:05:40.979 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T02:05:40.979 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T02:05:40.982 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T02:05:41.080 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T02:05:41.090 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T02:05:41.090 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T02:05:41.093 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T02:05:41.108 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-11T02:05:41.110 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-11T02:05:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T02:05:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-11T02:05:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 -17us[ -17us] +/- 50ms 2024-09-11T02:05:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 +787us[ +786us] +/- 51ms 2024-09-11T02:05:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -1035us[-1035us] +/- 72ms 2024-09-11T02:05:41.113 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T02:05:41.115 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T02:05:41.115 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-11T02:05:41.115 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -13us[+4722ns] +/- 50ms 2024-09-11T02:05:41.115 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 +803us[ +803us] +/- 51ms 2024-09-11T02:05:41.115 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -1026us[-1026us] +/- 72ms 2024-09-11T02:05:41.115 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T02:05:41.116 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T02:05:41.125 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T02:05:41.125 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T02:05:41.136 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T02:05:41.225 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T02:05:41.294 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T02:05:41.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T02:05:41.324 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T02:05:41.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T02:05:41.354 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T02:05:41.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T02:05:41.372 INFO:teuthology.task.internal:Duration was 852.767469 seconds 2024-09-11T02:05:41.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T02:05:41.381 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T02:05:41.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T02:05:41.384 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T02:05:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T02:05:41.434 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T02:05:41.796 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T02:05:41.796 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-11T02:05:41.797 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T02:05:41.857 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-09-11T02:05:41.857 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T02:05:41.885 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T02:05:41.885 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T02:05:41.900 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T02:05:41.955 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T02:05:41.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T02:05:41.967 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T02:05:42.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T02:05:42.108 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T02:05:42.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T02:05:42.134 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T02:05:42.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T02:05:42.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T02:05:42.176 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T02:05:42.197 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-11T02:05:42.224 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-09-11T02:05:42.268 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T02:05:42.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T02:05:42.282 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T02:05:42.323 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T02:05:42.324 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T02:05:42.333 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T02:05:42.334 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/remote/smithi073 2024-09-11T02:05:42.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T02:05:42.367 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_17:16:14-rados-wip-hemanth-testing-2024-09-10-0723-distro-default-smithi/7899935/remote/smithi203 2024-09-11T02:05:42.367 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T02:05:42.400 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T02:05:42.400 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T02:05:42.405 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T02:05:42.449 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T02:05:42.459 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T02:05:42.459 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T02:05:42.469 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T02:05:42.469 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T02:05:42.471 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T02:05:42.484 INFO:teuthology.orchestra.run.smithi073.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 02:05 /home/ubuntu/cephtest 2024-09-11T02:05:42.504 INFO:teuthology.orchestra.run.smithi203.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 02:05 /home/ubuntu/cephtest 2024-09-11T02:05:42.505 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T02:05:42.517 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T02:05:42.538 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/pool-create-delete} duration: 852.7674694061279 flavor: default owner: scheduled_hyelloji@teuthology success: true 2024-09-11T02:05:42.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T02:05:42.655 INFO:teuthology.run:pass